Aug 16 12:08:18 user nova-compute[73520]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 16 12:08:20 user nova-compute[73520]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73520) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 12:08:20 user nova-compute[73520]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73520) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 12:08:20 user nova-compute[73520]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73520) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 12:08:20 user nova-compute[73520]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 16 12:08:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:08:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:08:21 user nova-compute[73520]: INFO nova.virt.driver [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 16 12:08:21 user nova-compute[73520]: INFO nova.compute.provider_config [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] Acquiring lock "singleton_lock" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] Acquired lock "singleton_lock" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] Releasing lock "singleton_lock" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] Full set of CONF: {{(pid=73520) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ******************************************************************************** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] Configuration options gathered from: {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ================================================================================ {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] allow_resize_to_same_host      = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] arq_binding_timeout            = 300 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] backdoor_port                  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] backdoor_socket                = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] block_device_allocate_retries  = 300 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] block_device_allocate_retries_interval = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cert                           = self.pem {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute_monitors               = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] config_dir                     = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] config_drive_format            = iso9660 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] config_source                  = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] console_host                   = user {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] control_exchange               = nova {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cpu_allocation_ratio           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] daemon                         = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] debug                          = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] default_access_ip_network_name = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] default_availability_zone      = nova {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] default_ephemeral_format       = ext4 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] default_schedule_zone          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] disk_allocation_ratio          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] enable_new_services            = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] enabled_apis                   = ['osapi_compute'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] enabled_ssl_apis               = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] flat_injected                  = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] force_config_drive             = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] force_raw_images               = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] graceful_shutdown_timeout      = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] heal_instance_info_cache_interval = 60 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] host                           = user {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] instance_build_timeout         = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] instance_delete_interval       = 300 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] instance_format                = [instance: %(uuid)s]  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] instance_name_template         = instance-%08x {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] instance_usage_audit           = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] instance_usage_audit_period    = month {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] internal_service_availability_zone = internal {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] key                            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] live_migration_retry_count     = 30 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] log_config_append              = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] log_dir                        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] log_file                       = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] log_options                    = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] log_rotate_interval            = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] log_rotate_interval_type       = days {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] log_rotation_type              = none {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] long_rpc_timeout               = 1800 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] max_concurrent_builds          = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] max_concurrent_live_migrations = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] max_concurrent_snapshots       = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] max_local_block_devices        = 3 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] max_logfile_count              = 30 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] max_logfile_size_mb            = 200 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] maximum_instance_delete_attempts = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] metadata_listen                = 0.0.0.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] metadata_listen_port           = 8775 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] metadata_workers               = 3 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] migrate_max_retries            = -1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] mkisofs_cmd                    = genisoimage {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] my_ip                          = 10.0.0.210 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] network_allocate_retries       = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] osapi_compute_listen_port      = 8774 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] osapi_compute_unique_server_name_scope =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] osapi_compute_workers          = 3 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] password_length                = 12 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] periodic_enable                = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] periodic_fuzzy_delay           = 60 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] pointer_model                  = ps2mouse {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] preallocate_images             = none {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] publish_errors                 = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] pybasedir                      = /opt/stack/nova {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ram_allocation_ratio           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] rate_limit_burst               = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] rate_limit_except_level        = CRITICAL {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] rate_limit_interval            = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] reboot_timeout                 = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] reclaim_instance_interval      = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] record                         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] reimage_timeout_per_gb         = 60 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] report_interval                = 120 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] rescue_timeout                 = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] reserved_host_cpus             = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] reserved_host_disk_mb          = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] reserved_host_memory_mb        = 512 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] reserved_huge_pages            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] resize_confirm_window          = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] resize_fs_using_block_device   = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] resume_guests_state_on_host_boot = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] rpc_response_timeout           = 60 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] run_external_periodic_tasks    = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] running_deleted_instance_action = reap {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] running_deleted_instance_poll_interval = 1800 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] running_deleted_instance_timeout = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] scheduler_instance_sync_interval = 120 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] service_down_time              = 720 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] servicegroup_driver            = db {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] shelved_offload_time           = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] shelved_poll_interval          = 3600 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] shutdown_timeout               = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] source_is_ipv6                 = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ssl_only                       = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] state_path                     = /opt/stack/data/nova {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] sync_power_state_interval      = 600 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] sync_power_state_pool_size     = 1000 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] syslog_log_facility            = LOG_USER {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] tempdir                        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] timeout_nbd                    = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] transport_url                  = **** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] update_resources_interval      = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] use_cow_images                 = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] use_eventlog                   = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] use_journal                    = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] use_json                       = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] use_rootwrap_daemon            = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] use_stderr                     = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] use_syslog                     = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vcpu_pin_set                   = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plugging_is_fatal          = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plugging_timeout           = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] virt_mkfs                      = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] volume_usage_poll_interval     = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] watch_log_file                 = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] web                            = /usr/share/spice-html5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_concurrency.disable_process_locking = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.auth_strategy              = keystone {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.compute_link_prefix        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.dhcp_domain                = novalocal {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.enable_instance_password   = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.glance_link_prefix         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.instance_list_per_project_cells = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.list_records_by_skipping_down_cells = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.local_metadata_per_cell    = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.max_limit                  = 1000 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.metadata_cache_expiration  = 15 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.neutron_default_tenant_id  = default {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.use_forwarded_for          = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.use_neutron_default_nets   = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.vendordata_dynamic_targets = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.vendordata_jsonfile_path   = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.backend                  = dogpile.cache.memcached {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.backend_argument         = **** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.config_prefix            = cache.oslo {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.dead_timeout             = 60.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.debug_cache_backend      = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.enable_retry_client      = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.enable_socket_keepalive  = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.enabled                  = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.expiration_time          = 600 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.hashclient_retry_attempts = 2 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.memcache_dead_retry      = 300 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.memcache_password        =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.memcache_pool_maxsize    = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.memcache_sasl_enabled    = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.memcache_username        =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.proxies                  = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.retry_attempts           = 2 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.retry_delay              = 0.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.socket_keepalive_count   = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.socket_keepalive_idle    = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.socket_keepalive_interval = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.tls_allowed_ciphers      = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.tls_cafile               = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.tls_certfile             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.tls_enabled              = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cache.tls_keyfile              = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.auth_section            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.auth_type               = password {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.cafile                  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.certfile                = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.collect_timing          = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.cross_az_attach         = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.debug                   = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.endpoint_template       = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.http_retries            = 3 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.insecure                = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.keyfile                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.os_region_name          = RegionOne {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.split_loggers           = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cinder.timeout                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute.cpu_dedicated_set      = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute.cpu_shared_set         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute.image_type_exclude_list = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute.max_concurrent_disk_ops = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute.max_disk_devices_to_attach = -1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute.resource_provider_association_refresh = 300 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute.shutdown_retry_interval = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] conductor.workers              = 3 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] console.allowed_origins        = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] console.ssl_ciphers            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] console.ssl_minimum_version    = default {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] consoleauth.token_ttl          = 600 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.cafile                  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.certfile                = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.collect_timing          = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.connect_retries         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.connect_retry_delay     = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.endpoint_override       = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.insecure                = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.keyfile                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.max_version             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.min_version             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.region_name             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.service_name            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.service_type            = accelerator {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.split_loggers           = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.status_code_retries     = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.status_code_retry_delay = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.timeout                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] cyborg.version                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.backend               = sqlalchemy {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.connection            = **** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.connection_debug      = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.connection_parameters =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.connection_recycle_time = 3600 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.connection_trace      = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.db_inc_retry_interval = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.db_max_retries        = 20 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.db_max_retry_interval = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.db_retry_interval     = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.max_overflow          = 50 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.max_pool_size         = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.max_retries           = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.mysql_enable_ndb      = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.mysql_wsrep_sync_wait = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.pool_timeout          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.retry_interval        = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.slave_connection      = **** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] database.sqlite_synchronous    = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.backend           = sqlalchemy {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.connection        = **** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.connection_debug  = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.connection_parameters =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.connection_recycle_time = 3600 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.connection_trace  = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.db_inc_retry_interval = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.db_max_retries    = 20 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.db_max_retry_interval = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.db_retry_interval = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.max_overflow      = 50 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.max_pool_size     = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.max_retries       = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.mysql_enable_ndb  = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.pool_timeout      = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.retry_interval    = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.slave_connection  = **** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] api_database.sqlite_synchronous = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] devices.enabled_mdev_types     = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ephemeral_storage_encryption.enabled = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.api_servers             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.cafile                  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.certfile                = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.collect_timing          = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.connect_retries         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.connect_retry_delay     = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.debug                   = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.default_trusted_certificate_ids = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.enable_certificate_validation = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.enable_rbd_download     = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.endpoint_override       = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.insecure                = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.keyfile                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.max_version             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.min_version             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.num_retries             = 3 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.rbd_ceph_conf           =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.rbd_connect_timeout     = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.rbd_pool                =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.rbd_user                =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.region_name             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.service_name            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.service_type            = image {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.split_loggers           = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.status_code_retries     = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.status_code_retry_delay = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.timeout                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.verify_glance_signatures = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] glance.version                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] guestfs.debug                  = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.config_drive_cdrom      = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.config_drive_inject_password = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.enable_instance_metrics_collection = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.enable_remotefx         = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.instances_path_share    =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.iscsi_initiator_list    = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.limit_cpu_features      = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.power_state_check_timeframe = 60 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.use_multipath_io        = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.volume_attach_retry_count = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.vswitch_name            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] mks.enabled                    = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] image_cache.manager_interval   = 2400 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] image_cache.precache_concurrency = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] image_cache.remove_unused_base_images = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] image_cache.subdirectory_name  = _base {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.api_max_retries         = 60 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.api_retry_interval      = 2 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.auth_section            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.auth_type               = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.cafile                  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.certfile                = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.collect_timing          = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.connect_retries         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.connect_retry_delay     = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.endpoint_override       = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.insecure                = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.keyfile                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.max_version             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.min_version             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.partition_key           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.peer_list               = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.region_name             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.serial_console_state_timeout = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.service_name            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.service_type            = baremetal {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.split_loggers           = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.status_code_retries     = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.status_code_retry_delay = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.timeout                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ironic.version                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] key_manager.fixed_key          = **** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.barbican_api_version  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.barbican_endpoint     = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.barbican_endpoint_type = public {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.barbican_region_name  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.cafile                = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.certfile              = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.collect_timing        = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.insecure              = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.keyfile               = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.number_of_retries     = 60 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.retry_delay           = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.send_service_user_token = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.split_loggers         = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.timeout               = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.verify_ssl            = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican.verify_ssl_path       = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican_service_user.auth_section = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican_service_user.auth_type = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican_service_user.cafile   = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican_service_user.certfile = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican_service_user.collect_timing = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican_service_user.insecure = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican_service_user.keyfile  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican_service_user.split_loggers = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] barbican_service_user.timeout  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.approle_role_id          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.approle_secret_id        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.cafile                   = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.certfile                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.collect_timing           = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.insecure                 = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.keyfile                  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.kv_mountpoint            = secret {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.kv_version               = 2 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.namespace                = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.root_token_id            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.split_loggers            = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.ssl_ca_crt_file          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.timeout                  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.use_ssl                  = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.cafile                = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.certfile              = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.collect_timing        = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.connect_retries       = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.connect_retry_delay   = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.endpoint_override     = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.insecure              = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.keyfile               = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.max_version           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.min_version           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.region_name           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.service_name          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.service_type          = identity {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.split_loggers         = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.status_code_retries   = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.status_code_retry_delay = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.timeout               = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] keystone.version               = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.connection_uri         =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.cpu_mode               = custom {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: WARNING oslo_config.cfg [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.cpu_power_governor_high = performance {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.cpu_power_governor_low = powersave {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.cpu_power_management   = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.device_detach_attempts = 8 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.device_detach_timeout  = 20 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.disk_cachemodes        = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.disk_prefix            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.enabled_perf_events    = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.file_backed_memory     = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.gid_maps               = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.hw_disk_discard        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.hw_machine_type        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.images_rbd_glance_store_name =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.images_rbd_pool        = rbd {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.images_type            = default {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.images_volume_group    = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.inject_key             = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.inject_partition       = -2 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.inject_password        = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.iscsi_iface            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.iser_use_multipath     = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.live_migration_bandwidth = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.live_migration_downtime = 500 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.live_migration_inbound_addr = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.live_migration_permit_post_copy = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.live_migration_scheme  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.live_migration_timeout_action = abort {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.live_migration_tunnelled = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: WARNING oslo_config.cfg [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 16 12:08:21 user nova-compute[73520]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 16 12:08:21 user nova-compute[73520]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 16 12:08:21 user nova-compute[73520]: and ``live_migration_inbound_addr`` respectively.
Aug 16 12:08:21 user nova-compute[73520]: ).  Its value may be silently ignored in the future.
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.live_migration_with_native_tls = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.max_queues             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.nfs_mount_options      = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.num_memory_encrypted_guests = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.num_pcie_ports         = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.pmem_namespaces        = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.quobyte_client_cfg     = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.rbd_secret_uuid        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.rbd_user               = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.remote_filesystem_transport = ssh {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.rescue_image_id        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.rescue_kernel_id       = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.rescue_ramdisk_id      = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.rx_queue_size          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.smbfs_mount_options    =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.snapshot_compression   = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.snapshot_image_format  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.sparse_logical_volumes = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.swtpm_enabled          = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.swtpm_group            = tss {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.swtpm_user             = tss {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.sysinfo_serial         = unique {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.tb_cache_size          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.tx_queue_size          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.uid_maps               = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.use_virtio_for_bridges = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.virt_type              = kvm {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.volume_clear           = zero {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.volume_clear_size      = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.volume_use_multipath   = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.vzstorage_cache_path   = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.vzstorage_mount_user   = stack {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.auth_section           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.auth_type              = password {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.cafile                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.certfile               = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.collect_timing         = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.connect_retries        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.connect_retry_delay    = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.default_floating_pool  = public {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.endpoint_override      = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.extension_sync_interval = 600 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.http_retries           = 3 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.insecure               = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.keyfile                = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.max_version            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.min_version            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.ovs_bridge             = br-int {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.physnets               = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.region_name            = RegionOne {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.service_metadata_proxy = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.service_name           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.service_type           = network {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.split_loggers          = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.status_code_retries    = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.status_code_retry_delay = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.timeout                = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] neutron.version                = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] notifications.bdms_in_notifications = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] notifications.default_level    = INFO {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] notifications.notification_format = unversioned {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] notifications.notify_on_state_change = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] pci.alias                      = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] pci.device_spec                = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] pci.report_in_placement        = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.auth_section         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.auth_type            = password {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.cafile               = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.certfile             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.collect_timing       = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.connect_retries      = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.connect_retry_delay  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.default_domain_id    = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.default_domain_name  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.domain_id            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.domain_name          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.endpoint_override    = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.insecure             = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.keyfile              = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.max_version          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.min_version          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.password             = **** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.project_domain_id    = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.project_domain_name  = Default {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.project_id           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.project_name         = service {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.region_name          = RegionOne {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.service_name         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.service_type         = placement {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.split_loggers        = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.status_code_retries  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.status_code_retry_delay = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.system_scope         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.timeout              = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.trust_id             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.user_domain_id       = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.user_domain_name     = Default {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.user_id              = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.username             = placement {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] placement.version              = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] quota.cores                    = 20 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] quota.count_usage_from_placement = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] quota.injected_file_content_bytes = 10240 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] quota.injected_file_path_length = 255 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] quota.injected_files           = 5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] quota.instances                = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] quota.key_pairs                = 100 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] quota.metadata_items           = 128 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] quota.ram                      = 51200 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] quota.recheck_quota            = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] quota.server_group_members     = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] quota.server_groups            = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] rdp.enabled                    = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] scheduler.image_metadata_prefilter = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] scheduler.max_attempts         = 3 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] scheduler.max_placement_results = 1000 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] scheduler.query_placement_for_availability_zone = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] scheduler.query_placement_for_image_type_support = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] scheduler.workers              = 3 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.host_subset_size = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.isolated_hosts = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.isolated_images = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.pci_in_placement = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.track_instance_changes = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] metrics.required               = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] metrics.weight_multiplier      = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] metrics.weight_setting         = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] serial_console.enabled         = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] serial_console.port_range      = 10000:20000 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] serial_console.serialproxy_port = 6083 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] service_user.auth_section      = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] service_user.auth_type         = password {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] service_user.cafile            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] service_user.certfile          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] service_user.collect_timing    = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] service_user.insecure          = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] service_user.keyfile           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] service_user.send_service_user_token = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] service_user.split_loggers     = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] service_user.timeout           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] spice.agent_enabled            = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] spice.enabled                  = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] spice.html5proxy_port          = 6082 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] spice.image_compression        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] spice.jpeg_compression         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] spice.playback_compression     = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] spice.server_listen            = 127.0.0.1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] spice.streaming_mode           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] spice.zlib_compression         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] upgrade_levels.baseapi         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] upgrade_levels.cert            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] upgrade_levels.compute         = auto {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] upgrade_levels.conductor       = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] upgrade_levels.scheduler       = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vendordata_dynamic_auth.auth_section = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vendordata_dynamic_auth.auth_type = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vendordata_dynamic_auth.cafile = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vendordata_dynamic_auth.certfile = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vendordata_dynamic_auth.insecure = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vendordata_dynamic_auth.keyfile = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vendordata_dynamic_auth.timeout = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.api_retry_count         = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.ca_file                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.cache_prefix            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.cluster_name            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.connection_pool_size    = 10 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.console_delay_seconds   = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.datastore_regex         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.host_ip                 = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.host_password           = **** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.host_port               = 443 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.host_username           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.insecure                = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.integration_bridge      = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.maximum_objects         = 100 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.pbm_default_policy      = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.pbm_enabled             = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.pbm_wsdl_location       = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.serial_port_proxy_uri   = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.serial_port_service_uri = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.task_poll_interval      = 0.5 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.use_linked_clone        = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.vnc_keymap              = en-us {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.vnc_port                = 5900 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vmware.vnc_port_total          = 10000 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vnc.auth_schemes               = ['none'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vnc.enabled                    = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vnc.novncproxy_port            = 6080 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vnc.server_listen              = 0.0.0.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vnc.vencrypt_ca_certs          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vnc.vencrypt_client_cert       = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vnc.vencrypt_client_key        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.disable_rootwrap   = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.enable_numa_live_migration = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.libvirt_disable_apic = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] wsgi.client_socket_timeout     = 900 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] wsgi.default_pool_size         = 1000 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] wsgi.keep_alive                = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] wsgi.max_header_line           = 16384 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] wsgi.ssl_ca_file               = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] wsgi.ssl_cert_file             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] wsgi.ssl_key_file              = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] wsgi.tcp_keepidle              = 600 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] zvm.ca_file                    = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] zvm.cloud_connector_url        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] zvm.reachable_timeout          = 300 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_policy.enforce_new_defaults = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_policy.enforce_scope      = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_policy.policy_default_rule = default {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_policy.policy_file        = policy.yaml {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler.connection_string     = messaging:// {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler.enabled               = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler.es_doc_type           = notification {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler.es_scroll_size        = 10000 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler.es_scroll_time        = 2m {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler.filter_error_trace    = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler.hmac_keys             = **** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler.sentinel_service_name = mymaster {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler.socket_timeout        = 0.1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler.trace_requests        = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler.trace_sqlalchemy      = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler_jaeger.process_tags   = {} {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler_jaeger.service_name_prefix = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] profiler_otlp.service_name_prefix = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] remote_debug.host              = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] remote_debug.port              = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.ssl      = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_notifications.retry = -1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_messaging_notifications.transport_url = **** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.auth_section        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.auth_type           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.cafile              = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.certfile            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.collect_timing      = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.connect_retries     = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.connect_retry_delay = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.endpoint_id         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.endpoint_override   = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.insecure            = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.keyfile             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.max_version         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.min_version         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.region_name         = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.service_name        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.service_type        = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.split_loggers       = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.status_code_retries = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.status_code_retry_delay = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.timeout             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.valid_interfaces    = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_limit.version             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_reports.file_event_handler = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] oslo_reports.log_dir           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plug_ovs_privileged.group  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] vif_plug_ovs_privileged.user   = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_linux_bridge.flat_interface = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_ovs.isolate_vif         = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_vif_ovs.per_port_bridge     = False {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] os_brick.lock_path             = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] privsep_osbrick.capabilities   = [21] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] privsep_osbrick.group          = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] privsep_osbrick.helper_command = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] privsep_osbrick.user           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] nova_sys_admin.group           = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] nova_sys_admin.helper_command  = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] nova_sys_admin.user            = None {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG oslo_service.service [None req-3fea135c-d0fb-4217-86f1-94651e5c3eed None None] ******************************************************************************** {{(pid=73520) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 16 12:08:21 user nova-compute[73520]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 16 12:08:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Starting native event thread {{(pid=73520) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Starting green dispatch thread {{(pid=73520) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Starting connection event dispatch thread {{(pid=73520) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Connecting to libvirt: qemu:///system {{(pid=73520) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fa7752fcf10> {{(pid=73520) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 16 12:08:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fa7752fcf10> {{(pid=73520) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 16 12:08:21 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Connection event '1' reason 'None'
Aug 16 12:08:21 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 12:08:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.mount [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Initialising _HostMountState generation 0 {{(pid=73520) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 16 12:08:28 user nova-compute[73520]: INFO nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Libvirt host capabilities <capabilities>
Aug 16 12:08:28 user nova-compute[73520]:   <host>
Aug 16 12:08:28 user nova-compute[73520]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 16 12:08:28 user nova-compute[73520]:     <cpu>
Aug 16 12:08:28 user nova-compute[73520]:       <arch>x86_64</arch>
Aug 16 12:08:28 user nova-compute[73520]:       <model>IvyBridge-IBRS</model>
Aug 16 12:08:28 user nova-compute[73520]:       <vendor>Intel</vendor>
Aug 16 12:08:28 user nova-compute[73520]:       <microcode version='1070'/>
Aug 16 12:08:28 user nova-compute[73520]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 16 12:08:28 user nova-compute[73520]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='ss'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='vmx'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='pcid'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='osxsave'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='hypervisor'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='arat'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='tsc_adjust'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='md-clear'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='stibp'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='arch-capabilities'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='ssbd'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='invtsc'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='rsba'/>
Aug 16 12:08:28 user nova-compute[73520]:       <feature name='skip-l1dfl-vmentry'/>
Aug 16 12:08:28 user nova-compute[73520]:       <pages unit='KiB' size='4'/>
Aug 16 12:08:28 user nova-compute[73520]:       <pages unit='KiB' size='2048'/>
Aug 16 12:08:28 user nova-compute[73520]:     </cpu>
Aug 16 12:08:28 user nova-compute[73520]:     <power_management>
Aug 16 12:08:28 user nova-compute[73520]:       <suspend_mem/>
Aug 16 12:08:28 user nova-compute[73520]:       <suspend_disk/>
Aug 16 12:08:28 user nova-compute[73520]:       <suspend_hybrid/>
Aug 16 12:08:28 user nova-compute[73520]:     </power_management>
Aug 16 12:08:28 user nova-compute[73520]:     <iommu support='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     <migration_features>
Aug 16 12:08:28 user nova-compute[73520]:       <live/>
Aug 16 12:08:28 user nova-compute[73520]:       <uri_transports>
Aug 16 12:08:28 user nova-compute[73520]:         <uri_transport>tcp</uri_transport>
Aug 16 12:08:28 user nova-compute[73520]:         <uri_transport>rdma</uri_transport>
Aug 16 12:08:28 user nova-compute[73520]:       </uri_transports>
Aug 16 12:08:28 user nova-compute[73520]:     </migration_features>
Aug 16 12:08:28 user nova-compute[73520]:     <topology>
Aug 16 12:08:28 user nova-compute[73520]:       <cells num='2'>
Aug 16 12:08:28 user nova-compute[73520]:         <cell id='0'>
Aug 16 12:08:28 user nova-compute[73520]:           <memory unit='KiB'>8140616</memory>
Aug 16 12:08:28 user nova-compute[73520]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 16 12:08:28 user nova-compute[73520]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 12:08:28 user nova-compute[73520]:           <distances>
Aug 16 12:08:28 user nova-compute[73520]:             <sibling id='0' value='10'/>
Aug 16 12:08:28 user nova-compute[73520]:             <sibling id='1' value='20'/>
Aug 16 12:08:28 user nova-compute[73520]:           </distances>
Aug 16 12:08:28 user nova-compute[73520]:           <cpus num='6'>
Aug 16 12:08:28 user nova-compute[73520]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 16 12:08:28 user nova-compute[73520]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 16 12:08:28 user nova-compute[73520]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 16 12:08:28 user nova-compute[73520]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 16 12:08:28 user nova-compute[73520]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 16 12:08:28 user nova-compute[73520]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 16 12:08:28 user nova-compute[73520]:           </cpus>
Aug 16 12:08:28 user nova-compute[73520]:         </cell>
Aug 16 12:08:28 user nova-compute[73520]:         <cell id='1'>
Aug 16 12:08:28 user nova-compute[73520]:           <memory unit='KiB'>8255068</memory>
Aug 16 12:08:28 user nova-compute[73520]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 16 12:08:28 user nova-compute[73520]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 12:08:28 user nova-compute[73520]:           <distances>
Aug 16 12:08:28 user nova-compute[73520]:             <sibling id='0' value='20'/>
Aug 16 12:08:28 user nova-compute[73520]:             <sibling id='1' value='10'/>
Aug 16 12:08:28 user nova-compute[73520]:           </distances>
Aug 16 12:08:28 user nova-compute[73520]:           <cpus num='6'>
Aug 16 12:08:28 user nova-compute[73520]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 16 12:08:28 user nova-compute[73520]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 16 12:08:28 user nova-compute[73520]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 16 12:08:28 user nova-compute[73520]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 16 12:08:28 user nova-compute[73520]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 16 12:08:28 user nova-compute[73520]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 16 12:08:28 user nova-compute[73520]:           </cpus>
Aug 16 12:08:28 user nova-compute[73520]:         </cell>
Aug 16 12:08:28 user nova-compute[73520]:       </cells>
Aug 16 12:08:28 user nova-compute[73520]:     </topology>
Aug 16 12:08:28 user nova-compute[73520]:     <cache>
Aug 16 12:08:28 user nova-compute[73520]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 16 12:08:28 user nova-compute[73520]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 16 12:08:28 user nova-compute[73520]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 16 12:08:28 user nova-compute[73520]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 16 12:08:28 user nova-compute[73520]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 16 12:08:28 user nova-compute[73520]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 16 12:08:28 user nova-compute[73520]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 16 12:08:28 user nova-compute[73520]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 16 12:08:28 user nova-compute[73520]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 16 12:08:28 user nova-compute[73520]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 16 12:08:28 user nova-compute[73520]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 16 12:08:28 user nova-compute[73520]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 16 12:08:28 user nova-compute[73520]:     </cache>
Aug 16 12:08:28 user nova-compute[73520]:     <secmodel>
Aug 16 12:08:28 user nova-compute[73520]:       <model>apparmor</model>
Aug 16 12:08:28 user nova-compute[73520]:       <doi>0</doi>
Aug 16 12:08:28 user nova-compute[73520]:     </secmodel>
Aug 16 12:08:28 user nova-compute[73520]:     <secmodel>
Aug 16 12:08:28 user nova-compute[73520]:       <model>dac</model>
Aug 16 12:08:28 user nova-compute[73520]:       <doi>0</doi>
Aug 16 12:08:28 user nova-compute[73520]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 16 12:08:28 user nova-compute[73520]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 16 12:08:28 user nova-compute[73520]:     </secmodel>
Aug 16 12:08:28 user nova-compute[73520]:   </host>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='alpha'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>64</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>clipper</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='armv6l'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>spitz</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>nuri</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>kzm</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sx1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>z2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>tosa</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>n810</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>n800</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>terrier</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>midway</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>microbit</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>verdex</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>highbank</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>akita</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>connex</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>collie</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='armv7l'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>spitz</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>nuri</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>kzm</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sx1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>z2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>tosa</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>n810</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>n800</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>terrier</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>midway</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>microbit</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>verdex</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>highbank</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>akita</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>connex</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>collie</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='aarch64'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>64</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>spitz</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>nuri</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>kzm</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sx1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>z2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>tosa</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>n810</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>n800</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>terrier</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>midway</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>microbit</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>verdex</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>raspi3b</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='4'>highbank</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>akita</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>connex</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>collie</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <acpi default='on' toggle='yes'/>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='cris'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='i686'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>isapc</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>microvm</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='kvm'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <pae/>
Aug 16 12:08:28 user nova-compute[73520]:       <nonpae/>
Aug 16 12:08:28 user nova-compute[73520]:       <acpi default='on' toggle='yes'/>
Aug 16 12:08:28 user nova-compute[73520]:       <apic default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='m68k'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>an5206</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>q800</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>next-cube</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='microblaze'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='microblazeel'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='mips'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='16'>malta</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='mipsel'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='16'>malta</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='mips64'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>64</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='16'>malta</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>pica61</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>magnum</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='mips64el'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>64</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='16'>malta</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>pica61</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>magnum</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='16'>boston</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='ppc'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mac99</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>40p</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>taihu</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='ppc64'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>64</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>taihu</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>40p</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mac99</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='ppc64le'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>64</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>taihu</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>40p</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>mac99</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='riscv32'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='8'>spike</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>opentitan</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='8'>virt</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='riscv64'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>64</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='8'>spike</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>shakti_c</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='8'>virt</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:28 user nova-compute[73520]:     </arch>
Aug 16 12:08:28 user nova-compute[73520]:     <features>
Aug 16 12:08:28 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:28 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:28 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:28 user nova-compute[73520]:     </features>
Aug 16 12:08:28 user nova-compute[73520]:   </guest>
Aug 16 12:08:28 user nova-compute[73520]:   <guest>
Aug 16 12:08:28 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:28 user nova-compute[73520]:     <arch name='s390x'>
Aug 16 12:08:28 user nova-compute[73520]:       <wordsize>64</wordsize>
Aug 16 12:08:28 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 16 12:08:28 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:29 user nova-compute[73520]:     </arch>
Aug 16 12:08:29 user nova-compute[73520]:     <features>
Aug 16 12:08:29 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:29 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:29 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     </features>
Aug 16 12:08:29 user nova-compute[73520]:   </guest>
Aug 16 12:08:29 user nova-compute[73520]:   <guest>
Aug 16 12:08:29 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:29 user nova-compute[73520]:     <arch name='sh4'>
Aug 16 12:08:29 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:29 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>shix</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>r2d</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:29 user nova-compute[73520]:     </arch>
Aug 16 12:08:29 user nova-compute[73520]:     <features>
Aug 16 12:08:29 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:29 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:29 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     </features>
Aug 16 12:08:29 user nova-compute[73520]:   </guest>
Aug 16 12:08:29 user nova-compute[73520]:   <guest>
Aug 16 12:08:29 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:29 user nova-compute[73520]:     <arch name='sh4eb'>
Aug 16 12:08:29 user nova-compute[73520]:       <wordsize>64</wordsize>
Aug 16 12:08:29 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>shix</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>r2d</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:29 user nova-compute[73520]:     </arch>
Aug 16 12:08:29 user nova-compute[73520]:     <features>
Aug 16 12:08:29 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:29 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:29 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     </features>
Aug 16 12:08:29 user nova-compute[73520]:   </guest>
Aug 16 12:08:29 user nova-compute[73520]:   <guest>
Aug 16 12:08:29 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:29 user nova-compute[73520]:     <arch name='sparc'>
Aug 16 12:08:29 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:29 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>SS-5</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='4'>SS-20</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>LX</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>SS-4</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='4'>SS-10</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>Voyager</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:29 user nova-compute[73520]:     </arch>
Aug 16 12:08:29 user nova-compute[73520]:     <features>
Aug 16 12:08:29 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:29 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:29 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     </features>
Aug 16 12:08:29 user nova-compute[73520]:   </guest>
Aug 16 12:08:29 user nova-compute[73520]:   <guest>
Aug 16 12:08:29 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:29 user nova-compute[73520]:     <arch name='sparc64'>
Aug 16 12:08:29 user nova-compute[73520]:       <wordsize>64</wordsize>
Aug 16 12:08:29 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>sun4u</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>niagara</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>sun4v</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:29 user nova-compute[73520]:     </arch>
Aug 16 12:08:29 user nova-compute[73520]:     <features>
Aug 16 12:08:29 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:29 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:29 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     </features>
Aug 16 12:08:29 user nova-compute[73520]:   </guest>
Aug 16 12:08:29 user nova-compute[73520]:   <guest>
Aug 16 12:08:29 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:29 user nova-compute[73520]:     <arch name='x86_64'>
Aug 16 12:08:29 user nova-compute[73520]:       <wordsize>64</wordsize>
Aug 16 12:08:29 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='1'>isapc</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>microvm</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:29 user nova-compute[73520]:       <domain type='kvm'/>
Aug 16 12:08:29 user nova-compute[73520]:     </arch>
Aug 16 12:08:29 user nova-compute[73520]:     <features>
Aug 16 12:08:29 user nova-compute[73520]:       <acpi default='on' toggle='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:       <apic default='on' toggle='no'/>
Aug 16 12:08:29 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:29 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:29 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     </features>
Aug 16 12:08:29 user nova-compute[73520]:   </guest>
Aug 16 12:08:29 user nova-compute[73520]:   <guest>
Aug 16 12:08:29 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:29 user nova-compute[73520]:     <arch name='xtensa'>
Aug 16 12:08:29 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:29 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='4'>sim</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>kc705</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>ml605</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>virt</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>lx200</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>lx60</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:29 user nova-compute[73520]:     </arch>
Aug 16 12:08:29 user nova-compute[73520]:     <features>
Aug 16 12:08:29 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:29 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:29 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     </features>
Aug 16 12:08:29 user nova-compute[73520]:   </guest>
Aug 16 12:08:29 user nova-compute[73520]:   <guest>
Aug 16 12:08:29 user nova-compute[73520]:     <os_type>hvm</os_type>
Aug 16 12:08:29 user nova-compute[73520]:     <arch name='xtensaeb'>
Aug 16 12:08:29 user nova-compute[73520]:       <wordsize>32</wordsize>
Aug 16 12:08:29 user nova-compute[73520]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='4'>sim</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>kc705</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>ml605</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>virt</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>lx200</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>lx60</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 12:08:29 user nova-compute[73520]:       <domain type='qemu'/>
Aug 16 12:08:29 user nova-compute[73520]:     </arch>
Aug 16 12:08:29 user nova-compute[73520]:     <features>
Aug 16 12:08:29 user nova-compute[73520]:       <cpuselection/>
Aug 16 12:08:29 user nova-compute[73520]:       <deviceboot/>
Aug 16 12:08:29 user nova-compute[73520]:       <disksnapshot default='on' toggle='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     </features>
Aug 16 12:08:29 user nova-compute[73520]:   </guest>
Aug 16 12:08:29 user nova-compute[73520]: </capabilities>
Aug 16 12:08:29 user nova-compute[73520]: 
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 16 12:08:29 user nova-compute[73520]: <domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 12:08:29 user nova-compute[73520]:   <domain>kvm</domain>
Aug 16 12:08:29 user nova-compute[73520]:   <machine>pc-i440fx-jammy</machine>
Aug 16 12:08:29 user nova-compute[73520]:   <arch>i686</arch>
Aug 16 12:08:29 user nova-compute[73520]:   <vcpu max='255'/>
Aug 16 12:08:29 user nova-compute[73520]:   <iothreads supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:   <os supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='firmware'/>
Aug 16 12:08:29 user nova-compute[73520]:     <loader supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>rom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pflash</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='readonly'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>yes</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='secure'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </loader>
Aug 16 12:08:29 user nova-compute[73520]:   </os>
Aug 16 12:08:29 user nova-compute[73520]:   <cpu>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-passthrough' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='hostPassthroughMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='maximum' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='maximumMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>on</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-model' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <vendor>Intel</vendor>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ss'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='vmx'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='pcid'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='hypervisor'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arat'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='umip'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='md-clear'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibpb'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibrs'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='erms'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='lm'/>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='custom' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>qemu64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>qemu32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>phenom</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>n270</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>kvm64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>kvm32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>coreduo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>core2duo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>athlon</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Westmere</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Snowridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Penryn</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G5</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G4</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G1</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Nehalem</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Rome</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Milan</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Dhyana</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cooperlake</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Conroe</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>486</model>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:   </cpu>
Aug 16 12:08:29 user nova-compute[73520]:   <memoryBacking supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='sourceType'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>file</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>anonymous</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>memfd</value>
Aug 16 12:08:29 user nova-compute[73520]:     </enum>
Aug 16 12:08:29 user nova-compute[73520]:   </memoryBacking>
Aug 16 12:08:29 user nova-compute[73520]:   <devices>
Aug 16 12:08:29 user nova-compute[73520]:     <disk supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='diskDevice'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>disk</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cdrom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>floppy</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>lun</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='bus'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>ide</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>fdc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sata</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </disk>
Aug 16 12:08:29 user nova-compute[73520]:     <graphics supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sdl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vnc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>spice</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egl-headless</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </graphics>
Aug 16 12:08:29 user nova-compute[73520]:     <video supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='modelType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cirrus</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vmvga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>qxl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>none</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>bochs</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>ramfb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </video>
Aug 16 12:08:29 user nova-compute[73520]:     <hostdev supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='mode'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>subsystem</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='startupPolicy'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>default</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>mandatory</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>requisite</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>optional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='subsysType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pci</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='capsType'/>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='pciBackend'/>
Aug 16 12:08:29 user nova-compute[73520]:     </hostdev>
Aug 16 12:08:29 user nova-compute[73520]:     <rng supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>random</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egd</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>builtin</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </rng>
Aug 16 12:08:29 user nova-compute[73520]:     <filesystem supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='driverType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>path</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>handle</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtiofs</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </filesystem>
Aug 16 12:08:29 user nova-compute[73520]:     <tpm supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-tis</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-crb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>passthrough</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>emulator</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </tpm>
Aug 16 12:08:29 user nova-compute[73520]:   </devices>
Aug 16 12:08:29 user nova-compute[73520]:   <features>
Aug 16 12:08:29 user nova-compute[73520]:     <gic supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     <vmcoreinfo supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <genid supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backingStoreInput supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backup supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <sev supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:   </features>
Aug 16 12:08:29 user nova-compute[73520]: </domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:  {{(pid=73520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 16 12:08:29 user nova-compute[73520]: <domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 12:08:29 user nova-compute[73520]:   <domain>kvm</domain>
Aug 16 12:08:29 user nova-compute[73520]:   <machine>pc-q35-jammy</machine>
Aug 16 12:08:29 user nova-compute[73520]:   <arch>i686</arch>
Aug 16 12:08:29 user nova-compute[73520]:   <vcpu max='288'/>
Aug 16 12:08:29 user nova-compute[73520]:   <iothreads supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:   <os supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='firmware'/>
Aug 16 12:08:29 user nova-compute[73520]:     <loader supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>rom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pflash</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='readonly'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>yes</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='secure'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </loader>
Aug 16 12:08:29 user nova-compute[73520]:   </os>
Aug 16 12:08:29 user nova-compute[73520]:   <cpu>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-passthrough' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='hostPassthroughMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='maximum' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='maximumMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>on</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-model' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <vendor>Intel</vendor>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ss'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='vmx'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='pcid'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='hypervisor'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arat'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='umip'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='md-clear'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibpb'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibrs'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='erms'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='lm'/>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='custom' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>qemu64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>qemu32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>phenom</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>n270</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>kvm64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>kvm32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>coreduo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>core2duo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>athlon</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Westmere</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Snowridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Penryn</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G5</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G4</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G1</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Nehalem</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Rome</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Milan</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Dhyana</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cooperlake</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Conroe</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>486</model>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:   </cpu>
Aug 16 12:08:29 user nova-compute[73520]:   <memoryBacking supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='sourceType'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>file</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>anonymous</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>memfd</value>
Aug 16 12:08:29 user nova-compute[73520]:     </enum>
Aug 16 12:08:29 user nova-compute[73520]:   </memoryBacking>
Aug 16 12:08:29 user nova-compute[73520]:   <devices>
Aug 16 12:08:29 user nova-compute[73520]:     <disk supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='diskDevice'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>disk</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cdrom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>floppy</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>lun</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='bus'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>fdc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sata</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </disk>
Aug 16 12:08:29 user nova-compute[73520]:     <graphics supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sdl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vnc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>spice</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egl-headless</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </graphics>
Aug 16 12:08:29 user nova-compute[73520]:     <video supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='modelType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cirrus</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vmvga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>qxl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>none</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>bochs</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>ramfb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </video>
Aug 16 12:08:29 user nova-compute[73520]:     <hostdev supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='mode'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>subsystem</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='startupPolicy'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>default</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>mandatory</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>requisite</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>optional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='subsysType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pci</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='capsType'/>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='pciBackend'/>
Aug 16 12:08:29 user nova-compute[73520]:     </hostdev>
Aug 16 12:08:29 user nova-compute[73520]:     <rng supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>random</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egd</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>builtin</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </rng>
Aug 16 12:08:29 user nova-compute[73520]:     <filesystem supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='driverType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>path</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>handle</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtiofs</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </filesystem>
Aug 16 12:08:29 user nova-compute[73520]:     <tpm supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-tis</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-crb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>passthrough</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>emulator</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </tpm>
Aug 16 12:08:29 user nova-compute[73520]:   </devices>
Aug 16 12:08:29 user nova-compute[73520]:   <features>
Aug 16 12:08:29 user nova-compute[73520]:     <gic supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     <vmcoreinfo supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <genid supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backingStoreInput supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backup supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <sev supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:   </features>
Aug 16 12:08:29 user nova-compute[73520]: </domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:  {{(pid=73520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 16 12:08:29 user nova-compute[73520]: <domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 12:08:29 user nova-compute[73520]:   <domain>kvm</domain>
Aug 16 12:08:29 user nova-compute[73520]:   <machine>pc-q35-6.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:   <arch>i686</arch>
Aug 16 12:08:29 user nova-compute[73520]:   <vcpu max='288'/>
Aug 16 12:08:29 user nova-compute[73520]:   <iothreads supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:   <os supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='firmware'/>
Aug 16 12:08:29 user nova-compute[73520]:     <loader supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>rom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pflash</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='readonly'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>yes</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='secure'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </loader>
Aug 16 12:08:29 user nova-compute[73520]:   </os>
Aug 16 12:08:29 user nova-compute[73520]:   <cpu>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-passthrough' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='hostPassthroughMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='maximum' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='maximumMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>on</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-model' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <vendor>Intel</vendor>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ss'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='vmx'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='pcid'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='hypervisor'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arat'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='umip'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='md-clear'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibpb'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibrs'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='erms'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='lm'/>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='custom' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>qemu64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>qemu32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>phenom</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>n270</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>kvm64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>kvm32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>coreduo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>core2duo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>athlon</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Westmere</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Snowridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Penryn</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G5</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G4</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G1</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Nehalem</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Rome</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Milan</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Dhyana</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cooperlake</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Conroe</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>486</model>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:   </cpu>
Aug 16 12:08:29 user nova-compute[73520]:   <memoryBacking supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='sourceType'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>file</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>anonymous</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>memfd</value>
Aug 16 12:08:29 user nova-compute[73520]:     </enum>
Aug 16 12:08:29 user nova-compute[73520]:   </memoryBacking>
Aug 16 12:08:29 user nova-compute[73520]:   <devices>
Aug 16 12:08:29 user nova-compute[73520]:     <disk supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='diskDevice'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>disk</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cdrom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>floppy</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>lun</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='bus'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>fdc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sata</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </disk>
Aug 16 12:08:29 user nova-compute[73520]:     <graphics supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sdl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vnc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>spice</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egl-headless</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </graphics>
Aug 16 12:08:29 user nova-compute[73520]:     <video supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='modelType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cirrus</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vmvga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>qxl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>none</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>bochs</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>ramfb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </video>
Aug 16 12:08:29 user nova-compute[73520]:     <hostdev supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='mode'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>subsystem</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='startupPolicy'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>default</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>mandatory</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>requisite</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>optional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='subsysType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pci</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='capsType'/>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='pciBackend'/>
Aug 16 12:08:29 user nova-compute[73520]:     </hostdev>
Aug 16 12:08:29 user nova-compute[73520]:     <rng supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>random</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egd</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>builtin</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </rng>
Aug 16 12:08:29 user nova-compute[73520]:     <filesystem supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='driverType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>path</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>handle</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtiofs</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </filesystem>
Aug 16 12:08:29 user nova-compute[73520]:     <tpm supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-tis</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-crb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>passthrough</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>emulator</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </tpm>
Aug 16 12:08:29 user nova-compute[73520]:   </devices>
Aug 16 12:08:29 user nova-compute[73520]:   <features>
Aug 16 12:08:29 user nova-compute[73520]:     <gic supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     <vmcoreinfo supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <genid supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backingStoreInput supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backup supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <sev supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:   </features>
Aug 16 12:08:29 user nova-compute[73520]: </domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:  {{(pid=73520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 16 12:08:29 user nova-compute[73520]: <domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 12:08:29 user nova-compute[73520]:   <domain>kvm</domain>
Aug 16 12:08:29 user nova-compute[73520]:   <machine>pc-i440fx-6.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:   <arch>i686</arch>
Aug 16 12:08:29 user nova-compute[73520]:   <vcpu max='255'/>
Aug 16 12:08:29 user nova-compute[73520]:   <iothreads supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:   <os supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='firmware'/>
Aug 16 12:08:29 user nova-compute[73520]:     <loader supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>rom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pflash</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='readonly'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>yes</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='secure'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </loader>
Aug 16 12:08:29 user nova-compute[73520]:   </os>
Aug 16 12:08:29 user nova-compute[73520]:   <cpu>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-passthrough' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='hostPassthroughMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='maximum' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='maximumMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>on</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-model' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <vendor>Intel</vendor>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ss'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='vmx'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='pcid'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='hypervisor'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arat'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='umip'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='md-clear'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibpb'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibrs'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='erms'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='lm'/>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='custom' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>qemu64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>qemu32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>phenom</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>n270</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>kvm64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>kvm32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>coreduo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>core2duo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>athlon</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Westmere</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Snowridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Penryn</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G5</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G4</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G1</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Nehalem</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Rome</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Milan</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Dhyana</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cooperlake</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Conroe</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>486</model>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:   </cpu>
Aug 16 12:08:29 user nova-compute[73520]:   <memoryBacking supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='sourceType'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>file</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>anonymous</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>memfd</value>
Aug 16 12:08:29 user nova-compute[73520]:     </enum>
Aug 16 12:08:29 user nova-compute[73520]:   </memoryBacking>
Aug 16 12:08:29 user nova-compute[73520]:   <devices>
Aug 16 12:08:29 user nova-compute[73520]:     <disk supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='diskDevice'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>disk</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cdrom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>floppy</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>lun</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='bus'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>ide</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>fdc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sata</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </disk>
Aug 16 12:08:29 user nova-compute[73520]:     <graphics supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sdl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vnc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>spice</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egl-headless</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </graphics>
Aug 16 12:08:29 user nova-compute[73520]:     <video supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='modelType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cirrus</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vmvga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>qxl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>none</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>bochs</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>ramfb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </video>
Aug 16 12:08:29 user nova-compute[73520]:     <hostdev supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='mode'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>subsystem</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='startupPolicy'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>default</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>mandatory</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>requisite</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>optional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='subsysType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pci</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='capsType'/>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='pciBackend'/>
Aug 16 12:08:29 user nova-compute[73520]:     </hostdev>
Aug 16 12:08:29 user nova-compute[73520]:     <rng supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>random</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egd</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>builtin</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </rng>
Aug 16 12:08:29 user nova-compute[73520]:     <filesystem supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='driverType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>path</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>handle</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtiofs</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </filesystem>
Aug 16 12:08:29 user nova-compute[73520]:     <tpm supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-tis</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-crb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>passthrough</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>emulator</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </tpm>
Aug 16 12:08:29 user nova-compute[73520]:   </devices>
Aug 16 12:08:29 user nova-compute[73520]:   <features>
Aug 16 12:08:29 user nova-compute[73520]:     <gic supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     <vmcoreinfo supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <genid supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backingStoreInput supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backup supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <sev supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:   </features>
Aug 16 12:08:29 user nova-compute[73520]: </domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:  {{(pid=73520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 16 12:08:29 user nova-compute[73520]: <domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 12:08:29 user nova-compute[73520]:   <domain>kvm</domain>
Aug 16 12:08:29 user nova-compute[73520]:   <machine>pc-i440fx-jammy</machine>
Aug 16 12:08:29 user nova-compute[73520]:   <arch>x86_64</arch>
Aug 16 12:08:29 user nova-compute[73520]:   <vcpu max='255'/>
Aug 16 12:08:29 user nova-compute[73520]:   <iothreads supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:   <os supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='firmware'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>efi</value>
Aug 16 12:08:29 user nova-compute[73520]:     </enum>
Aug 16 12:08:29 user nova-compute[73520]:     <loader supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>rom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pflash</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='readonly'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>yes</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='secure'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </loader>
Aug 16 12:08:29 user nova-compute[73520]:   </os>
Aug 16 12:08:29 user nova-compute[73520]:   <cpu>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-passthrough' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='hostPassthroughMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>on</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='maximum' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='maximumMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>on</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-model' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <vendor>Intel</vendor>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ss'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='vmx'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='pcid'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='hypervisor'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arat'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='umip'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='md-clear'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='invtsc'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibpb'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibrs'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='rsba'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='erms'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='custom' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>qemu64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>qemu32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>phenom</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>n270</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>kvm64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>kvm32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>coreduo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>core2duo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>athlon</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Westmere</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Snowridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Penryn</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G5</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G4</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Opteron_G1</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Nehalem</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Rome</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Milan</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Dhyana</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cooperlake</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Conroe</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>486</model>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:   </cpu>
Aug 16 12:08:29 user nova-compute[73520]:   <memoryBacking supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='sourceType'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>file</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>anonymous</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>memfd</value>
Aug 16 12:08:29 user nova-compute[73520]:     </enum>
Aug 16 12:08:29 user nova-compute[73520]:   </memoryBacking>
Aug 16 12:08:29 user nova-compute[73520]:   <devices>
Aug 16 12:08:29 user nova-compute[73520]:     <disk supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='diskDevice'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>disk</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cdrom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>floppy</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>lun</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='bus'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>ide</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>fdc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sata</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </disk>
Aug 16 12:08:29 user nova-compute[73520]:     <graphics supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sdl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vnc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>spice</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egl-headless</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </graphics>
Aug 16 12:08:29 user nova-compute[73520]:     <video supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='modelType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cirrus</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vmvga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>qxl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>none</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>bochs</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>ramfb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </video>
Aug 16 12:08:29 user nova-compute[73520]:     <hostdev supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='mode'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>subsystem</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='startupPolicy'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>default</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>mandatory</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>requisite</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>optional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='subsysType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pci</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='capsType'/>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='pciBackend'/>
Aug 16 12:08:29 user nova-compute[73520]:     </hostdev>
Aug 16 12:08:29 user nova-compute[73520]:     <rng supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>random</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egd</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>builtin</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </rng>
Aug 16 12:08:29 user nova-compute[73520]:     <filesystem supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='driverType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>path</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>handle</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtiofs</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </filesystem>
Aug 16 12:08:29 user nova-compute[73520]:     <tpm supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-tis</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-crb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>passthrough</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>emulator</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </tpm>
Aug 16 12:08:29 user nova-compute[73520]:   </devices>
Aug 16 12:08:29 user nova-compute[73520]:   <features>
Aug 16 12:08:29 user nova-compute[73520]:     <gic supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     <vmcoreinfo supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <genid supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backingStoreInput supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backup supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <sev supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:   </features>
Aug 16 12:08:29 user nova-compute[73520]: </domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:  {{(pid=73520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 16 12:08:29 user nova-compute[73520]: <domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 12:08:29 user nova-compute[73520]:   <domain>kvm</domain>
Aug 16 12:08:29 user nova-compute[73520]:   <machine>pc-q35-jammy</machine>
Aug 16 12:08:29 user nova-compute[73520]:   <arch>x86_64</arch>
Aug 16 12:08:29 user nova-compute[73520]:   <vcpu max='288'/>
Aug 16 12:08:29 user nova-compute[73520]:   <iothreads supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:   <os supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='firmware'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>efi</value>
Aug 16 12:08:29 user nova-compute[73520]:     </enum>
Aug 16 12:08:29 user nova-compute[73520]:     <loader supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>rom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pflash</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='readonly'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>yes</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='secure'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>yes</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </loader>
Aug 16 12:08:29 user nova-compute[73520]:   </os>
Aug 16 12:08:29 user nova-compute[73520]:   <cpu>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-passthrough' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='hostPassthroughMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>on</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='maximum' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='maximumMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>on</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-model' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <vendor>Intel</vendor>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ss'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='vmx'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='pcid'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='hypervisor'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arat'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='umip'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='md-clear'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='invtsc'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibpb'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibrs'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='rsba'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='erms'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='custom' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>qemu64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>qemu32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>phenom</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>n270</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>kvm64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>kvm32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>coreduo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>core2duo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>athlon</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Westmere</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Snowridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Penryn</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G5</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G4</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Opteron_G1</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Nehalem</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Rome</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Milan</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Dhyana</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cooperlake</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Conroe</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>486</model>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:   </cpu>
Aug 16 12:08:29 user nova-compute[73520]:   <memoryBacking supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='sourceType'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>file</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>anonymous</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>memfd</value>
Aug 16 12:08:29 user nova-compute[73520]:     </enum>
Aug 16 12:08:29 user nova-compute[73520]:   </memoryBacking>
Aug 16 12:08:29 user nova-compute[73520]:   <devices>
Aug 16 12:08:29 user nova-compute[73520]:     <disk supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='diskDevice'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>disk</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cdrom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>floppy</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>lun</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='bus'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>fdc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sata</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </disk>
Aug 16 12:08:29 user nova-compute[73520]:     <graphics supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sdl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vnc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>spice</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egl-headless</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </graphics>
Aug 16 12:08:29 user nova-compute[73520]:     <video supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='modelType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cirrus</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vmvga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>qxl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>none</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>bochs</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>ramfb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </video>
Aug 16 12:08:29 user nova-compute[73520]:     <hostdev supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='mode'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>subsystem</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='startupPolicy'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>default</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>mandatory</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>requisite</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>optional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='subsysType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pci</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='capsType'/>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='pciBackend'/>
Aug 16 12:08:29 user nova-compute[73520]:     </hostdev>
Aug 16 12:08:29 user nova-compute[73520]:     <rng supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>random</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egd</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>builtin</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </rng>
Aug 16 12:08:29 user nova-compute[73520]:     <filesystem supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='driverType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>path</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>handle</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtiofs</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </filesystem>
Aug 16 12:08:29 user nova-compute[73520]:     <tpm supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-tis</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-crb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>passthrough</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>emulator</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </tpm>
Aug 16 12:08:29 user nova-compute[73520]:   </devices>
Aug 16 12:08:29 user nova-compute[73520]:   <features>
Aug 16 12:08:29 user nova-compute[73520]:     <gic supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     <vmcoreinfo supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <genid supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backingStoreInput supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backup supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <sev supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:   </features>
Aug 16 12:08:29 user nova-compute[73520]: </domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:  {{(pid=73520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 16 12:08:29 user nova-compute[73520]: <domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 12:08:29 user nova-compute[73520]:   <domain>kvm</domain>
Aug 16 12:08:29 user nova-compute[73520]:   <machine>pc-q35-6.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:   <arch>x86_64</arch>
Aug 16 12:08:29 user nova-compute[73520]:   <vcpu max='288'/>
Aug 16 12:08:29 user nova-compute[73520]:   <iothreads supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:   <os supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='firmware'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>efi</value>
Aug 16 12:08:29 user nova-compute[73520]:     </enum>
Aug 16 12:08:29 user nova-compute[73520]:     <loader supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>rom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pflash</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='readonly'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>yes</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='secure'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>yes</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </loader>
Aug 16 12:08:29 user nova-compute[73520]:   </os>
Aug 16 12:08:29 user nova-compute[73520]:   <cpu>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-passthrough' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='hostPassthroughMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>on</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='maximum' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='maximumMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>on</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-model' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <vendor>Intel</vendor>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ss'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='vmx'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='pcid'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='hypervisor'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arat'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='umip'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='md-clear'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='invtsc'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibpb'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibrs'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='rsba'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='erms'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='custom' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>qemu64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>qemu32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>phenom</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>n270</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>kvm64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>kvm32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>coreduo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>core2duo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>athlon</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Westmere</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Snowridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Penryn</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G5</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G4</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Opteron_G1</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Nehalem</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Rome</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Milan</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Dhyana</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cooperlake</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Conroe</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>486</model>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:   </cpu>
Aug 16 12:08:29 user nova-compute[73520]:   <memoryBacking supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='sourceType'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>file</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>anonymous</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>memfd</value>
Aug 16 12:08:29 user nova-compute[73520]:     </enum>
Aug 16 12:08:29 user nova-compute[73520]:   </memoryBacking>
Aug 16 12:08:29 user nova-compute[73520]:   <devices>
Aug 16 12:08:29 user nova-compute[73520]:     <disk supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='diskDevice'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>disk</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cdrom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>floppy</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>lun</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='bus'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>fdc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sata</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </disk>
Aug 16 12:08:29 user nova-compute[73520]:     <graphics supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sdl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vnc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>spice</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egl-headless</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </graphics>
Aug 16 12:08:29 user nova-compute[73520]:     <video supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='modelType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cirrus</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vmvga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>qxl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>none</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>bochs</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>ramfb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </video>
Aug 16 12:08:29 user nova-compute[73520]:     <hostdev supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='mode'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>subsystem</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='startupPolicy'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>default</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>mandatory</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>requisite</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>optional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='subsysType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pci</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='capsType'/>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='pciBackend'/>
Aug 16 12:08:29 user nova-compute[73520]:     </hostdev>
Aug 16 12:08:29 user nova-compute[73520]:     <rng supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>random</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egd</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>builtin</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </rng>
Aug 16 12:08:29 user nova-compute[73520]:     <filesystem supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='driverType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>path</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>handle</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtiofs</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </filesystem>
Aug 16 12:08:29 user nova-compute[73520]:     <tpm supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-tis</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-crb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>passthrough</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>emulator</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </tpm>
Aug 16 12:08:29 user nova-compute[73520]:   </devices>
Aug 16 12:08:29 user nova-compute[73520]:   <features>
Aug 16 12:08:29 user nova-compute[73520]:     <gic supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     <vmcoreinfo supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <genid supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backingStoreInput supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backup supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <sev supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:   </features>
Aug 16 12:08:29 user nova-compute[73520]: </domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:  {{(pid=73520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 16 12:08:29 user nova-compute[73520]: <domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 12:08:29 user nova-compute[73520]:   <domain>kvm</domain>
Aug 16 12:08:29 user nova-compute[73520]:   <machine>pc-i440fx-6.2</machine>
Aug 16 12:08:29 user nova-compute[73520]:   <arch>x86_64</arch>
Aug 16 12:08:29 user nova-compute[73520]:   <vcpu max='255'/>
Aug 16 12:08:29 user nova-compute[73520]:   <iothreads supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:   <os supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='firmware'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>efi</value>
Aug 16 12:08:29 user nova-compute[73520]:     </enum>
Aug 16 12:08:29 user nova-compute[73520]:     <loader supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>rom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pflash</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='readonly'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>yes</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='secure'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>no</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </loader>
Aug 16 12:08:29 user nova-compute[73520]:   </os>
Aug 16 12:08:29 user nova-compute[73520]:   <cpu>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-passthrough' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='hostPassthroughMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>on</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='maximum' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='maximumMigratable'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>on</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>off</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='host-model' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <vendor>Intel</vendor>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ss'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='vmx'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='pcid'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='hypervisor'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arat'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='umip'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='md-clear'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='invtsc'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibpb'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='ibrs'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-stibp'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='rsba'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='erms'/>
Aug 16 12:08:29 user nova-compute[73520]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:     <mode name='custom' supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>qemu64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>qemu32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>phenom</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>pentium</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>n270</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>kvm64</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>kvm32</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>coreduo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>core2duo</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>athlon</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Westmere</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Snowridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Skylake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>SandyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Penryn</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G5</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G4</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G3</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Opteron_G2</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Opteron_G1</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Nehalem</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>IvyBridge</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Icelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Haswell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Rome</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-Milan</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>EPYC</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Dhyana</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cooperlake</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>Conroe</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='no'>Broadwell</model>
Aug 16 12:08:29 user nova-compute[73520]:       <model usable='yes'>486</model>
Aug 16 12:08:29 user nova-compute[73520]:     </mode>
Aug 16 12:08:29 user nova-compute[73520]:   </cpu>
Aug 16 12:08:29 user nova-compute[73520]:   <memoryBacking supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:     <enum name='sourceType'>
Aug 16 12:08:29 user nova-compute[73520]:       <value>file</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>anonymous</value>
Aug 16 12:08:29 user nova-compute[73520]:       <value>memfd</value>
Aug 16 12:08:29 user nova-compute[73520]:     </enum>
Aug 16 12:08:29 user nova-compute[73520]:   </memoryBacking>
Aug 16 12:08:29 user nova-compute[73520]:   <devices>
Aug 16 12:08:29 user nova-compute[73520]:     <disk supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='diskDevice'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>disk</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cdrom</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>floppy</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>lun</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='bus'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>ide</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>fdc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sata</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </disk>
Aug 16 12:08:29 user nova-compute[73520]:     <graphics supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='type'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>sdl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vnc</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>spice</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egl-headless</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </graphics>
Aug 16 12:08:29 user nova-compute[73520]:     <video supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='modelType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>cirrus</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>vmvga</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>qxl</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>none</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>bochs</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>ramfb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </video>
Aug 16 12:08:29 user nova-compute[73520]:     <hostdev supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='mode'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>subsystem</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='startupPolicy'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>default</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>mandatory</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>requisite</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>optional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='subsysType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>usb</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>pci</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>scsi</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='capsType'/>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='pciBackend'/>
Aug 16 12:08:29 user nova-compute[73520]:     </hostdev>
Aug 16 12:08:29 user nova-compute[73520]:     <rng supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtio-non-transitional</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>random</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>egd</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>builtin</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </rng>
Aug 16 12:08:29 user nova-compute[73520]:     <filesystem supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='driverType'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>path</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>handle</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>virtiofs</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </filesystem>
Aug 16 12:08:29 user nova-compute[73520]:     <tpm supported='yes'>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='model'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-tis</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>tpm-crb</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:       <enum name='backendModel'>
Aug 16 12:08:29 user nova-compute[73520]:         <value>passthrough</value>
Aug 16 12:08:29 user nova-compute[73520]:         <value>emulator</value>
Aug 16 12:08:29 user nova-compute[73520]:       </enum>
Aug 16 12:08:29 user nova-compute[73520]:     </tpm>
Aug 16 12:08:29 user nova-compute[73520]:   </devices>
Aug 16 12:08:29 user nova-compute[73520]:   <features>
Aug 16 12:08:29 user nova-compute[73520]:     <gic supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:     <vmcoreinfo supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <genid supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backingStoreInput supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <backup supported='yes'/>
Aug 16 12:08:29 user nova-compute[73520]:     <sev supported='no'/>
Aug 16 12:08:29 user nova-compute[73520]:   </features>
Aug 16 12:08:29 user nova-compute[73520]: </domainCapabilities>
Aug 16 12:08:29 user nova-compute[73520]:  {{(pid=73520) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73520) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73520) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Checking secure boot support for host arch (x86_64) {{(pid=73520) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Checking secure boot support for host arch (x86_64) {{(pid=73520) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Checking secure boot support for host arch (x86_64) {{(pid=73520) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 12:08:29 user nova-compute[73520]: INFO nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Secure Boot support detected
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] cpu compare xml: <cpu match="exact">
Aug 16 12:08:29 user nova-compute[73520]:   <model>Nehalem</model>
Aug 16 12:08:29 user nova-compute[73520]: </cpu>
Aug 16 12:08:29 user nova-compute[73520]:  {{(pid=73520) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 16 12:08:29 user nova-compute[73520]: INFO nova.virt.node [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Generated node identity 70dde5f5-9594-47c3-954e-598dd3089747
Aug 16 12:08:29 user nova-compute[73520]: INFO nova.virt.node [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Wrote node identity 70dde5f5-9594-47c3-954e-598dd3089747 to /opt/stack/data/nova/compute_id
Aug 16 12:08:29 user nova-compute[73520]: WARNING nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Compute nodes ['70dde5f5-9594-47c3-954e-598dd3089747'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 16 12:08:29 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 16 12:08:29 user nova-compute[73520]: WARNING nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 12:08:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:08:29 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:08:29 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Hypervisor/Node resource view: name=user free_ram=10870MB free_disk=26.329082489013672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:08:29 user nova-compute[73520]: WARNING nova.compute.resource_tracker [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] No compute node record for user:70dde5f5-9594-47c3-954e-598dd3089747: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 70dde5f5-9594-47c3-954e-598dd3089747 could not be found.
Aug 16 12:08:29 user nova-compute[73520]: INFO nova.compute.resource_tracker [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Compute node record created for user:user with uuid: 70dde5f5-9594-47c3-954e-598dd3089747
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:08:29 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [req-5cdd8cb0-96e0-4ec9-9af6-c8005dfdbdaf] Created resource provider record via placement API for resource provider with UUID 70dde5f5-9594-47c3-954e-598dd3089747 and name user.
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73520) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 16 12:08:29 user nova-compute[73520]: INFO nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] kernel doesn't support AMD SEV
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Libvirt baseline CPU <cpu>
Aug 16 12:08:29 user nova-compute[73520]:   <arch>x86_64</arch>
Aug 16 12:08:29 user nova-compute[73520]:   <model>Nehalem</model>
Aug 16 12:08:29 user nova-compute[73520]:   <vendor>Intel</vendor>
Aug 16 12:08:29 user nova-compute[73520]:   <topology sockets="6" cores="1" threads="1"/>
Aug 16 12:08:29 user nova-compute[73520]: </cpu>
Aug 16 12:08:29 user nova-compute[73520]:  {{(pid=73520) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Updated inventory for provider 70dde5f5-9594-47c3-954e-598dd3089747 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Updating resource provider 70dde5f5-9594-47c3-954e-598dd3089747 generation from 0 to 1 during operation: update_inventory {{(pid=73520) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 12:08:29 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 12:08:30 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Updating resource provider 70dde5f5-9594-47c3-954e-598dd3089747 generation from 1 to 2 during operation: update_traits {{(pid=73520) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 12:08:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:08:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:08:30 user nova-compute[73520]: DEBUG nova.service [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Creating RPC server for service compute {{(pid=73520) start /opt/stack/nova/nova/service.py:182}}
Aug 16 12:08:30 user nova-compute[73520]: DEBUG nova.service [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Join ServiceGroup membership for this service compute {{(pid=73520) start /opt/stack/nova/nova/service.py:199}}
Aug 16 12:08:30 user nova-compute[73520]: DEBUG nova.servicegroup.drivers.db [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73520) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 16 12:08:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:08:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:09:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:09:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:09:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:09:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:09:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 12:09:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:09:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:09:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:09:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:09:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:09:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:09:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:09:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:09:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:09:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:09:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:09:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:09:21 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:09:21 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:09:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=10265MB free_disk=26.232769012451172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:09:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:09:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:09:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:09:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:09:21 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:09:21 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:09:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:09:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:10:21 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:10:21 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:10:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=10201MB free_disk=26.278823852539062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:10:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:10:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:10:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:10:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:10:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:10:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:10:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:10:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:10:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 12:10:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:10:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:11:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:11:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:11:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:11:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:11:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:11:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:11:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:11:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:11:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:11:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:11:22 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:11:22 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:11:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=10168MB free_disk=26.063030242919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:11:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:11:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:11:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:11:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:11:22 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:11:22 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:11:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:11:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:11:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:11:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:11:24 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:11:24 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:11:24 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:11:24 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 12:11:24 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:12:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:12:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:12:22 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:12:22 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:12:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=9473MB free_disk=26.086353302001953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:12:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:12:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:12:22 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:12:22 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:12:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:12:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:12:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:12:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:12:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:12:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:12:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:12:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:12:24 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:12:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:12:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:12:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:12:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 12:12:26 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:12:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "9e339769-9db0-4fa3-b966-3cc1c2a24789" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:12:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:12:29 user nova-compute[73520]: INFO nova.compute.claims [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Claim successful on node user
Aug 16 12:12:30 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:12:30 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:12:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:12:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:12:30 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:12:30 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:12:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:12:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:12:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:12:30 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Creating image(s)
Aug 16 12:12:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "/opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "/opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:31 user nova-compute[73520]: DEBUG nova.policy [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ad9c789ec514d6ebe3414865ba8ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a6719264f84d308785e48fbca9ee31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:12:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61.part --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61.part --force-share --output=json" returned: 0 in 0.229s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:32 user nova-compute[73520]: DEBUG nova.virt.images [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe was qcow2, converting to raw {{(pid=73520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 12:12:32 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:12:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61.part /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61.converted {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61.part /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61.converted" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61.converted --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.925s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:32 user nova-compute[73520]: INFO oslo.privsep.daemon [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdceqzqn5/privsep.sock']
Aug 16 12:12:32 user sudo[82734]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdceqzqn5/privsep.sock
Aug 16 12:12:32 user sudo[82734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 12:12:34 user sudo[82734]: pam_unix(sudo:session): session closed for user root
Aug 16 12:12:34 user nova-compute[73520]: INFO oslo.privsep.daemon [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Spawned new privsep daemon via rootwrap
Aug 16 12:12:34 user nova-compute[73520]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 12:12:34 user nova-compute[73520]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 12:12:34 user nova-compute[73520]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 16 12:12:34 user nova-compute[73520]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82791
Aug 16 12:12:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.158s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk 1073741824" returned: 0 in 0.042s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:34 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Successfully created port: b98fbde0-e7c2-4038-b436-57567ad76754 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:12:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:35 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:12:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:35 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Cannot resize image /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:12:35 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lazy-loading 'migration_context' on Instance uuid 9e339769-9db0-4fa3-b966-3cc1c2a24789 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:12:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:12:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Ensure instance console log exists: /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:12:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Successfully updated port: b98fbde0-e7c2-4038-b436-57567ad76754 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "refresh_cache-9e339769-9db0-4fa3-b966-3cc1c2a24789" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquired lock "refresh_cache-9e339769-9db0-4fa3-b966-3cc1c2a24789" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:12:38 user nova-compute[73520]: INFO nova.compute.claims [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Claim successful on node user
Aug 16 12:12:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-8cd9badc-0272-449e-82b0-e2f4f75b0169 req-1de2fd37-b936-4542-9ec4-d8f0273e75a5 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Received event network-changed-b98fbde0-e7c2-4038-b436-57567ad76754 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-8cd9badc-0272-449e-82b0-e2f4f75b0169 req-1de2fd37-b936-4542-9ec4-d8f0273e75a5 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Refreshing instance network info cache due to event network-changed-b98fbde0-e7c2-4038-b436-57567ad76754. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8cd9badc-0272-449e-82b0-e2f4f75b0169 req-1de2fd37-b936-4542-9ec4-d8f0273e75a5 service nova] Acquiring lock "refresh_cache-9e339769-9db0-4fa3-b966-3cc1c2a24789" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.network.neutron [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:12:39 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Updating instance_info_cache with network_info: [{"id": "b98fbde0-e7c2-4038-b436-57567ad76754", "address": "fa:16:3e:9f:95:73", "network": {"id": "c508e024-e875-4ffb-9945-d6ef43b597d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-953780218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a6719264f84d308785e48fbca9ee31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98fbde0-e7", "ovs_interfaceid": "b98fbde0-e7c2-4038-b436-57567ad76754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Releasing lock "refresh_cache-9e339769-9db0-4fa3-b966-3cc1c2a24789" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Instance network_info: |[{"id": "b98fbde0-e7c2-4038-b436-57567ad76754", "address": "fa:16:3e:9f:95:73", "network": {"id": "c508e024-e875-4ffb-9945-d6ef43b597d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-953780218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a6719264f84d308785e48fbca9ee31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98fbde0-e7", "ovs_interfaceid": "b98fbde0-e7c2-4038-b436-57567ad76754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8cd9badc-0272-449e-82b0-e2f4f75b0169 req-1de2fd37-b936-4542-9ec4-d8f0273e75a5 service nova] Acquired lock "refresh_cache-9e339769-9db0-4fa3-b966-3cc1c2a24789" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.network.neutron [req-8cd9badc-0272-449e-82b0-e2f4f75b0169 req-1de2fd37-b936-4542-9ec4-d8f0273e75a5 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Refreshing network info cache for port b98fbde0-e7c2-4038-b436-57567ad76754 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Start _get_guest_xml network_info=[{"id": "b98fbde0-e7c2-4038-b436-57567ad76754", "address": "fa:16:3e:9f:95:73", "network": {"id": "c508e024-e875-4ffb-9945-d6ef43b597d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-953780218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a6719264f84d308785e48fbca9ee31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98fbde0-e7", "ovs_interfaceid": "b98fbde0-e7c2-4038-b436-57567ad76754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:12:39 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Creating image(s)
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "/opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "/opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:39 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:12:39 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1703936356',display_name='tempest-DeleteServersTestJSON-server-1703936356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1703936356',id=1,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a6719264f84d308785e48fbca9ee31',ramdisk_id='',reservation_id='r-5tgibv09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1976385223',owner_user_name='tempest-DeleteServersTestJSON-1976385223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:12:30Z,user_data=None,user_id='1ad9c789ec514d6ebe3414865ba8ef92',uuid=9e339769-9db0-4fa3-b966-3cc1c2a24789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b98fbde0-e7c2-4038-b436-57567ad76754", "address": "fa:16:3e:9f:95:73", "network": {"id": "c508e024-e875-4ffb-9945-d6ef43b597d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-953780218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a6719264f84d308785e48fbca9ee31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98fbde0-e7", "ovs_interfaceid": "b98fbde0-e7c2-4038-b436-57567ad76754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Converting VIF {"id": "b98fbde0-e7c2-4038-b436-57567ad76754", "address": "fa:16:3e:9f:95:73", "network": {"id": "c508e024-e875-4ffb-9945-d6ef43b597d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-953780218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a6719264f84d308785e48fbca9ee31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98fbde0-e7", "ovs_interfaceid": "b98fbde0-e7c2-4038-b436-57567ad76754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:95:73,bridge_name='br-int',has_traffic_filtering=True,id=b98fbde0-e7c2-4038-b436-57567ad76754,network=Network(c508e024-e875-4ffb-9945-d6ef43b597d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98fbde0-e7') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e339769-9db0-4fa3-b966-3cc1c2a24789 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:12:39 user nova-compute[73520]:   <uuid>9e339769-9db0-4fa3-b966-3cc1c2a24789</uuid>
Aug 16 12:12:39 user nova-compute[73520]:   <name>instance-00000001</name>
Aug 16 12:12:39 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:12:39 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:12:39 user nova-compute[73520]:   <metadata>
Aug 16 12:12:39 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:12:39 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:12:39 user nova-compute[73520]:       <nova:name>tempest-DeleteServersTestJSON-server-1703936356</nova:name>
Aug 16 12:12:39 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:12:39</nova:creationTime>
Aug 16 12:12:39 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:12:39 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:12:39 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:12:39 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:12:39 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:12:39 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:12:39 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:12:39 user nova-compute[73520]:       <nova:owner>
Aug 16 12:12:39 user nova-compute[73520]:         <nova:user uuid="1ad9c789ec514d6ebe3414865ba8ef92">tempest-DeleteServersTestJSON-1976385223-project-member</nova:user>
Aug 16 12:12:39 user nova-compute[73520]:         <nova:project uuid="06a6719264f84d308785e48fbca9ee31">tempest-DeleteServersTestJSON-1976385223</nova:project>
Aug 16 12:12:39 user nova-compute[73520]:       </nova:owner>
Aug 16 12:12:39 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:12:39 user nova-compute[73520]:       <nova:ports>
Aug 16 12:12:39 user nova-compute[73520]:         <nova:port uuid="b98fbde0-e7c2-4038-b436-57567ad76754">
Aug 16 12:12:39 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 12:12:39 user nova-compute[73520]:         </nova:port>
Aug 16 12:12:39 user nova-compute[73520]:       </nova:ports>
Aug 16 12:12:39 user nova-compute[73520]:     </nova:instance>
Aug 16 12:12:39 user nova-compute[73520]:   </metadata>
Aug 16 12:12:39 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:12:39 user nova-compute[73520]:     <system>
Aug 16 12:12:39 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:12:39 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:12:39 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:12:39 user nova-compute[73520]:       <entry name="serial">9e339769-9db0-4fa3-b966-3cc1c2a24789</entry>
Aug 16 12:12:39 user nova-compute[73520]:       <entry name="uuid">9e339769-9db0-4fa3-b966-3cc1c2a24789</entry>
Aug 16 12:12:39 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:12:39 user nova-compute[73520]:     </system>
Aug 16 12:12:39 user nova-compute[73520]:   </sysinfo>
Aug 16 12:12:39 user nova-compute[73520]:   <os>
Aug 16 12:12:39 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:12:39 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:12:39 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:12:39 user nova-compute[73520]:   </os>
Aug 16 12:12:39 user nova-compute[73520]:   <features>
Aug 16 12:12:39 user nova-compute[73520]:     <acpi/>
Aug 16 12:12:39 user nova-compute[73520]:     <apic/>
Aug 16 12:12:39 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:12:39 user nova-compute[73520]:   </features>
Aug 16 12:12:39 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:12:39 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:12:39 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:12:39 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:12:39 user nova-compute[73520]:   </clock>
Aug 16 12:12:39 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:12:39 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:12:39 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:12:39 user nova-compute[73520]:   </cpu>
Aug 16 12:12:39 user nova-compute[73520]:   <devices>
Aug 16 12:12:39 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:12:39 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:12:39 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk"/>
Aug 16 12:12:39 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:12:39 user nova-compute[73520]:     </disk>
Aug 16 12:12:39 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:12:39 user nova-compute[73520]:       <mac address="fa:16:3e:9f:95:73"/>
Aug 16 12:12:39 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:12:39 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:12:39 user nova-compute[73520]:       <target dev="tapb98fbde0-e7"/>
Aug 16 12:12:39 user nova-compute[73520]:     </interface>
Aug 16 12:12:39 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:12:39 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/console.log" append="off"/>
Aug 16 12:12:39 user nova-compute[73520]:     </serial>
Aug 16 12:12:39 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:12:39 user nova-compute[73520]:     <video>
Aug 16 12:12:39 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:12:39 user nova-compute[73520]:     </video>
Aug 16 12:12:39 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:12:39 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:12:39 user nova-compute[73520]:     </rng>
Aug 16 12:12:39 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:12:39 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:12:39 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:12:39 user nova-compute[73520]:     </memballoon>
Aug 16 12:12:39 user nova-compute[73520]:   </devices>
Aug 16 12:12:39 user nova-compute[73520]: </domain>
Aug 16 12:12:39 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1703936356',display_name='tempest-DeleteServersTestJSON-server-1703936356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1703936356',id=1,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06a6719264f84d308785e48fbca9ee31',ramdisk_id='',reservation_id='r-5tgibv09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1976385223',owner_user_name='tempest-DeleteServersTestJSON-1976385223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:12:30Z,user_data=None,user_id='1ad9c789ec514d6ebe3414865ba8ef92',uuid=9e339769-9db0-4fa3-b966-3cc1c2a24789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b98fbde0-e7c2-4038-b436-57567ad76754", "address": "fa:16:3e:9f:95:73", "network": {"id": "c508e024-e875-4ffb-9945-d6ef43b597d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-953780218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a6719264f84d308785e48fbca9ee31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98fbde0-e7", "ovs_interfaceid": "b98fbde0-e7c2-4038-b436-57567ad76754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Converting VIF {"id": "b98fbde0-e7c2-4038-b436-57567ad76754", "address": "fa:16:3e:9f:95:73", "network": {"id": "c508e024-e875-4ffb-9945-d6ef43b597d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-953780218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a6719264f84d308785e48fbca9ee31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98fbde0-e7", "ovs_interfaceid": "b98fbde0-e7c2-4038-b436-57567ad76754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:95:73,bridge_name='br-int',has_traffic_filtering=True,id=b98fbde0-e7c2-4038-b436-57567ad76754,network=Network(c508e024-e875-4ffb-9945-d6ef43b597d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98fbde0-e7') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG os_vif [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:95:73,bridge_name='br-int',has_traffic_filtering=True,id=b98fbde0-e7c2-4038-b436-57567ad76754,network=Network(c508e024-e875-4ffb-9945-d6ef43b597d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98fbde0-e7') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Created schema index Interface.name {{(pid=73520) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Created schema index Port.name {{(pid=73520) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Created schema index Bridge.name {{(pid=73520) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.policy [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92bb596f4b334418913e5aff74e0cd9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfcad0609442ac978b2f28869a61a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [POLLOUT] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.254s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:12:39 user nova-compute[73520]: INFO oslo.privsep.daemon [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpn8lck61b/privsep.sock']
Aug 16 12:12:39 user sudo[82831]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpn8lck61b/privsep.sock
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:39 user sudo[82831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 12:12:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk 1073741824" returned: 0 in 0.048s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:12:40 user nova-compute[73520]: INFO nova.compute.claims [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Claim successful on node user
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Cannot resize image /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.objects.instance [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lazy-loading 'migration_context' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Ensure instance console log exists: /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.network.neutron [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:12:40 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:12:40 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Creating image(s)
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "/opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "/opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "/opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.175s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG nova.policy [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2495e37a99546deb000789aac42ed34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dd566104a645fd8abda43da8d9b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.169s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk 1073741824" returned: 0 in 0.045s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Checking if we can resize image /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Cannot resize image /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG nova.objects.instance [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'migration_context' on Instance uuid 443357b7-2fc9-4ac7-8fce-7dc2bede4369 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Ensure instance console log exists: /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG nova.network.neutron [req-8cd9badc-0272-449e-82b0-e2f4f75b0169 req-1de2fd37-b936-4542-9ec4-d8f0273e75a5 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Updated VIF entry in instance network info cache for port b98fbde0-e7c2-4038-b436-57567ad76754. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG nova.network.neutron [req-8cd9badc-0272-449e-82b0-e2f4f75b0169 req-1de2fd37-b936-4542-9ec4-d8f0273e75a5 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Updating instance_info_cache with network_info: [{"id": "b98fbde0-e7c2-4038-b436-57567ad76754", "address": "fa:16:3e:9f:95:73", "network": {"id": "c508e024-e875-4ffb-9945-d6ef43b597d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-953780218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a6719264f84d308785e48fbca9ee31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98fbde0-e7", "ovs_interfaceid": "b98fbde0-e7c2-4038-b436-57567ad76754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:12:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8cd9badc-0272-449e-82b0-e2f4f75b0169 req-1de2fd37-b936-4542-9ec4-d8f0273e75a5 service nova] Releasing lock "refresh_cache-9e339769-9db0-4fa3-b966-3cc1c2a24789" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:12:41 user sudo[82831]: pam_unix(sudo:session): session closed for user root
Aug 16 12:12:41 user nova-compute[73520]: INFO oslo.privsep.daemon [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Spawned new privsep daemon via rootwrap
Aug 16 12:12:41 user nova-compute[73520]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 12:12:41 user nova-compute[73520]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 12:12:41 user nova-compute[73520]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 16 12:12:41 user nova-compute[73520]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82859
Aug 16 12:12:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb98fbde0-e7, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:12:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb98fbde0-e7, col_values=(('external_ids', {'iface-id': 'b98fbde0-e7c2-4038-b436-57567ad76754', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:95:73', 'vm-uuid': '9e339769-9db0-4fa3-b966-3cc1c2a24789'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:12:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:12:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:42 user nova-compute[73520]: INFO os_vif [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:95:73,bridge_name='br-int',has_traffic_filtering=True,id=b98fbde0-e7c2-4038-b436-57567ad76754,network=Network(c508e024-e875-4ffb-9945-d6ef43b597d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98fbde0-e7')
Aug 16 12:12:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:12:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] No VIF found with MAC fa:16:3e:9f:95:73, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:12:42 user nova-compute[73520]: DEBUG nova.network.neutron [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Successfully created port: ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:12:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:43 user nova-compute[73520]: DEBUG nova.network.neutron [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Successfully created port: e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:12:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692187965.135418, 9e339769-9db0-4fa3-b966-3cc1c2a24789 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:12:45 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] VM Resumed (Lifecycle Event)
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.network.neutron [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Successfully updated port: ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:12:45 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Instance spawned successfully.
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquired lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.network.neutron [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-ed452275-666d-4f44-9378-cd301ba42541 req-9770a791-0450-4ef5-843c-d7c65de8127e service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Received event network-changed-ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-ed452275-666d-4f44-9378-cd301ba42541 req-9770a791-0450-4ef5-843c-d7c65de8127e service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Refreshing instance network info cache due to event network-changed-ec555ffc-ecb2-48d7-8c11-d07a3238df5a. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed452275-666d-4f44-9378-cd301ba42541 req-9770a791-0450-4ef5-843c-d7c65de8127e service nova] Acquiring lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:12:45 user nova-compute[73520]: INFO nova.compute.manager [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Took 14.76 seconds to spawn the instance on the hypervisor.
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:12:45 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692187965.1409738, 9e339769-9db0-4fa3-b966-3cc1c2a24789 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:12:45 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] VM Started (Lifecycle Event)
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.network.neutron [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:12:45 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:12:45 user nova-compute[73520]: INFO nova.compute.manager [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Took 15.85 seconds to build instance.
Aug 16 12:12:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7f7886b-2119-4623-bdbf-ca004c0a83eb tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.055s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "636510f6-acfa-4705-bfb1-03df3f9297be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "636510f6-acfa-4705-bfb1-03df3f9297be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:12:46 user nova-compute[73520]: INFO nova.compute.claims [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Claim successful on node user
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updating instance_info_cache with network_info: [{"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Releasing lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Instance network_info: |[{"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed452275-666d-4f44-9378-cd301ba42541 req-9770a791-0450-4ef5-843c-d7c65de8127e service nova] Acquired lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.network.neutron [req-ed452275-666d-4f44-9378-cd301ba42541 req-9770a791-0450-4ef5-843c-d7c65de8127e service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Refreshing network info cache for port ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Start _get_guest_xml network_info=[{"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:12:46 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:12:46 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1044531346',display_name='tempest-ServerActionsTestOtherA-server-1044531346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1044531346',id=3,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl3ev6edzI1KLHo1Y5B96ptBm6NSqIbcBOFcMZceXonYnWR3AckvFat7GQrt1EQ+8fQAGMP/p7GDPbXyfJwBrIOn5y+eKTCEQMF2Y9CFOeelDTAPhe+VbqGs9Aw6sueMA==',key_name='tempest-keypair-2118649879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-cy2juzvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=443357b7-2fc9-4ac7-8fce-7dc2bede4369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:80:85,bridge_name='br-int',has_traffic_filtering=True,id=ec555ffc-ecb2-48d7-8c11-d07a3238df5a,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec555ffc-ec') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.objects.instance [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'pci_devices' on Instance uuid 443357b7-2fc9-4ac7-8fce-7dc2bede4369 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:12:46 user nova-compute[73520]:   <uuid>443357b7-2fc9-4ac7-8fce-7dc2bede4369</uuid>
Aug 16 12:12:46 user nova-compute[73520]:   <name>instance-00000003</name>
Aug 16 12:12:46 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:12:46 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:12:46 user nova-compute[73520]:   <metadata>
Aug 16 12:12:46 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:12:46 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:12:46 user nova-compute[73520]:       <nova:name>tempest-ServerActionsTestOtherA-server-1044531346</nova:name>
Aug 16 12:12:46 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:12:46</nova:creationTime>
Aug 16 12:12:46 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:12:46 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:12:46 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:12:46 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:12:46 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:12:46 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:12:46 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:12:46 user nova-compute[73520]:       <nova:owner>
Aug 16 12:12:46 user nova-compute[73520]:         <nova:user uuid="d2495e37a99546deb000789aac42ed34">tempest-ServerActionsTestOtherA-294187005-project-member</nova:user>
Aug 16 12:12:46 user nova-compute[73520]:         <nova:project uuid="57dd566104a645fd8abda43da8d9b980">tempest-ServerActionsTestOtherA-294187005</nova:project>
Aug 16 12:12:46 user nova-compute[73520]:       </nova:owner>
Aug 16 12:12:46 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:12:46 user nova-compute[73520]:       <nova:ports>
Aug 16 12:12:46 user nova-compute[73520]:         <nova:port uuid="ec555ffc-ecb2-48d7-8c11-d07a3238df5a">
Aug 16 12:12:46 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 12:12:46 user nova-compute[73520]:         </nova:port>
Aug 16 12:12:46 user nova-compute[73520]:       </nova:ports>
Aug 16 12:12:46 user nova-compute[73520]:     </nova:instance>
Aug 16 12:12:46 user nova-compute[73520]:   </metadata>
Aug 16 12:12:46 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:12:46 user nova-compute[73520]:     <system>
Aug 16 12:12:46 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:12:46 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:12:46 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:12:46 user nova-compute[73520]:       <entry name="serial">443357b7-2fc9-4ac7-8fce-7dc2bede4369</entry>
Aug 16 12:12:46 user nova-compute[73520]:       <entry name="uuid">443357b7-2fc9-4ac7-8fce-7dc2bede4369</entry>
Aug 16 12:12:46 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:12:46 user nova-compute[73520]:     </system>
Aug 16 12:12:46 user nova-compute[73520]:   </sysinfo>
Aug 16 12:12:46 user nova-compute[73520]:   <os>
Aug 16 12:12:46 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:12:46 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:12:46 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:12:46 user nova-compute[73520]:   </os>
Aug 16 12:12:46 user nova-compute[73520]:   <features>
Aug 16 12:12:46 user nova-compute[73520]:     <acpi/>
Aug 16 12:12:46 user nova-compute[73520]:     <apic/>
Aug 16 12:12:46 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:12:46 user nova-compute[73520]:   </features>
Aug 16 12:12:46 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:12:46 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:12:46 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:12:46 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:12:46 user nova-compute[73520]:   </clock>
Aug 16 12:12:46 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:12:46 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:12:46 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:12:46 user nova-compute[73520]:   </cpu>
Aug 16 12:12:46 user nova-compute[73520]:   <devices>
Aug 16 12:12:46 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:12:46 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:12:46 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk"/>
Aug 16 12:12:46 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:12:46 user nova-compute[73520]:     </disk>
Aug 16 12:12:46 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:12:46 user nova-compute[73520]:       <mac address="fa:16:3e:e4:80:85"/>
Aug 16 12:12:46 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:12:46 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:12:46 user nova-compute[73520]:       <target dev="tapec555ffc-ec"/>
Aug 16 12:12:46 user nova-compute[73520]:     </interface>
Aug 16 12:12:46 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:12:46 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/console.log" append="off"/>
Aug 16 12:12:46 user nova-compute[73520]:     </serial>
Aug 16 12:12:46 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:12:46 user nova-compute[73520]:     <video>
Aug 16 12:12:46 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:12:46 user nova-compute[73520]:     </video>
Aug 16 12:12:46 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:12:46 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:12:46 user nova-compute[73520]:     </rng>
Aug 16 12:12:46 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:12:46 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:12:46 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:12:46 user nova-compute[73520]:     </memballoon>
Aug 16 12:12:46 user nova-compute[73520]:   </devices>
Aug 16 12:12:46 user nova-compute[73520]: </domain>
Aug 16 12:12:46 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1044531346',display_name='tempest-ServerActionsTestOtherA-server-1044531346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1044531346',id=3,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl3ev6edzI1KLHo1Y5B96ptBm6NSqIbcBOFcMZceXonYnWR3AckvFat7GQrt1EQ+8fQAGMP/p7GDPbXyfJwBrIOn5y+eKTCEQMF2Y9CFOeelDTAPhe+VbqGs9Aw6sueMA==',key_name='tempest-keypair-2118649879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-cy2juzvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=443357b7-2fc9-4ac7-8fce-7dc2bede4369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:80:85,bridge_name='br-int',has_traffic_filtering=True,id=ec555ffc-ecb2-48d7-8c11-d07a3238df5a,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec555ffc-ec') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG os_vif [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:80:85,bridge_name='br-int',has_traffic_filtering=True,id=ec555ffc-ecb2-48d7-8c11-d07a3238df5a,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec555ffc-ec') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec555ffc-ec, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec555ffc-ec, col_values=(('external_ids', {'iface-id': 'ec555ffc-ecb2-48d7-8c11-d07a3238df5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:80:85', 'vm-uuid': '443357b7-2fc9-4ac7-8fce-7dc2bede4369'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:46 user nova-compute[73520]: INFO os_vif [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:80:85,bridge_name='br-int',has_traffic_filtering=True,id=ec555ffc-ecb2-48d7-8c11-d07a3238df5a,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec555ffc-ec')
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No VIF found with MAC fa:16:3e:e4:80:85, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:12:46 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Successfully updated port: e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquired lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:12:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:12:47 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Creating image(s)
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "/opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "/opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "/opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG nova.policy [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6426c917725745038fdb1d03fec4a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1059841e2ee04ca4870497a1ec60bcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG nova.network.neutron [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.298s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-59cb1653-bd10-42a5-91d2-b647b6489923 req-723ef661-7283-46b2-b449-e48a42e1486a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-changed-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-59cb1653-bd10-42a5-91d2-b647b6489923 req-723ef661-7283-46b2-b449-e48a42e1486a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Refreshing instance network info cache due to event network-changed-e7070f8b-1a15-4dad-8fac-bd4518007ed3. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-59cb1653-bd10-42a5-91d2-b647b6489923 req-723ef661-7283-46b2-b449-e48a42e1486a service nova] Acquiring lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk 1073741824" returned: 0 in 0.068s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.371s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.259s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:12:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Cannot resize image /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.objects.instance [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'migration_context' on Instance uuid 636510f6-acfa-4705-bfb1-03df3f9297be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Ensure instance console log exists: /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.network.neutron [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updating instance_info_cache with network_info: [{"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Releasing lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.compute.manager [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Instance network_info: |[{"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-59cb1653-bd10-42a5-91d2-b647b6489923 req-723ef661-7283-46b2-b449-e48a42e1486a service nova] Acquired lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.network.neutron [req-59cb1653-bd10-42a5-91d2-b647b6489923 req-723ef661-7283-46b2-b449-e48a42e1486a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Refreshing network info cache for port e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Start _get_guest_xml network_info=[{"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:12:48 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:12:48 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1867177793',display_name='tempest-ServerStableDeviceRescueTest-server-1867177793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1867177793',id=2,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW1sULHDOwqYzwZNX8bdrBg2J4hzkPj384swsuGLaI5fdvQMlFCxH9VVU6Igf3uJTT5VzWdM2O6U06SbkepqbwghltsmDpN24/4L4JDgtpUfVbM6sx8uSo4KvWrF9zMfw==',key_name='tempest-keypair-1070714980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ecfcad0609442ac978b2f28869a61a2',ramdisk_id='',reservation_id='r-35vu3dd3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-229465501',owner_user_name='tempest-ServerStableDeviceRescueTest-229465501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:12:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92bb596f4b334418913e5aff74e0cd9b',uuid=2a72dbe6-dfc2-4527-8213-c2e9fe2f553a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Converting VIF {"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:a8:3f,bridge_name='br-int',has_traffic_filtering=True,id=e7070f8b-1a15-4dad-8fac-bd4518007ed3,network=Network(68120f7a-55c5-44f9-8ba2-7b43fb289064),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7070f8b-1a') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.objects.instance [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:12:48 user nova-compute[73520]:   <uuid>2a72dbe6-dfc2-4527-8213-c2e9fe2f553a</uuid>
Aug 16 12:12:48 user nova-compute[73520]:   <name>instance-00000002</name>
Aug 16 12:12:48 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:12:48 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:12:48 user nova-compute[73520]:   <metadata>
Aug 16 12:12:48 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:12:48 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:12:48 user nova-compute[73520]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1867177793</nova:name>
Aug 16 12:12:48 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:12:48</nova:creationTime>
Aug 16 12:12:48 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:12:48 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:12:48 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:12:48 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:12:48 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:12:48 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:12:48 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:12:48 user nova-compute[73520]:       <nova:owner>
Aug 16 12:12:48 user nova-compute[73520]:         <nova:user uuid="92bb596f4b334418913e5aff74e0cd9b">tempest-ServerStableDeviceRescueTest-229465501-project-member</nova:user>
Aug 16 12:12:48 user nova-compute[73520]:         <nova:project uuid="3ecfcad0609442ac978b2f28869a61a2">tempest-ServerStableDeviceRescueTest-229465501</nova:project>
Aug 16 12:12:48 user nova-compute[73520]:       </nova:owner>
Aug 16 12:12:48 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:12:48 user nova-compute[73520]:       <nova:ports>
Aug 16 12:12:48 user nova-compute[73520]:         <nova:port uuid="e7070f8b-1a15-4dad-8fac-bd4518007ed3">
Aug 16 12:12:48 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 12:12:48 user nova-compute[73520]:         </nova:port>
Aug 16 12:12:48 user nova-compute[73520]:       </nova:ports>
Aug 16 12:12:48 user nova-compute[73520]:     </nova:instance>
Aug 16 12:12:48 user nova-compute[73520]:   </metadata>
Aug 16 12:12:48 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:12:48 user nova-compute[73520]:     <system>
Aug 16 12:12:48 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:12:48 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:12:48 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:12:48 user nova-compute[73520]:       <entry name="serial">2a72dbe6-dfc2-4527-8213-c2e9fe2f553a</entry>
Aug 16 12:12:48 user nova-compute[73520]:       <entry name="uuid">2a72dbe6-dfc2-4527-8213-c2e9fe2f553a</entry>
Aug 16 12:12:48 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:12:48 user nova-compute[73520]:     </system>
Aug 16 12:12:48 user nova-compute[73520]:   </sysinfo>
Aug 16 12:12:48 user nova-compute[73520]:   <os>
Aug 16 12:12:48 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:12:48 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:12:48 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:12:48 user nova-compute[73520]:   </os>
Aug 16 12:12:48 user nova-compute[73520]:   <features>
Aug 16 12:12:48 user nova-compute[73520]:     <acpi/>
Aug 16 12:12:48 user nova-compute[73520]:     <apic/>
Aug 16 12:12:48 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:12:48 user nova-compute[73520]:   </features>
Aug 16 12:12:48 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:12:48 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:12:48 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:12:48 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:12:48 user nova-compute[73520]:   </clock>
Aug 16 12:12:48 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:12:48 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:12:48 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:12:48 user nova-compute[73520]:   </cpu>
Aug 16 12:12:48 user nova-compute[73520]:   <devices>
Aug 16 12:12:48 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:12:48 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:12:48 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk"/>
Aug 16 12:12:48 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:12:48 user nova-compute[73520]:     </disk>
Aug 16 12:12:48 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:12:48 user nova-compute[73520]:       <mac address="fa:16:3e:58:a8:3f"/>
Aug 16 12:12:48 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:12:48 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:12:48 user nova-compute[73520]:       <target dev="tape7070f8b-1a"/>
Aug 16 12:12:48 user nova-compute[73520]:     </interface>
Aug 16 12:12:48 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:12:48 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/console.log" append="off"/>
Aug 16 12:12:48 user nova-compute[73520]:     </serial>
Aug 16 12:12:48 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:12:48 user nova-compute[73520]:     <video>
Aug 16 12:12:48 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:12:48 user nova-compute[73520]:     </video>
Aug 16 12:12:48 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:12:48 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:12:48 user nova-compute[73520]:     </rng>
Aug 16 12:12:48 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:12:48 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:12:48 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:12:48 user nova-compute[73520]:     </memballoon>
Aug 16 12:12:48 user nova-compute[73520]:   </devices>
Aug 16 12:12:48 user nova-compute[73520]: </domain>
Aug 16 12:12:48 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1867177793',display_name='tempest-ServerStableDeviceRescueTest-server-1867177793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1867177793',id=2,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW1sULHDOwqYzwZNX8bdrBg2J4hzkPj384swsuGLaI5fdvQMlFCxH9VVU6Igf3uJTT5VzWdM2O6U06SbkepqbwghltsmDpN24/4L4JDgtpUfVbM6sx8uSo4KvWrF9zMfw==',key_name='tempest-keypair-1070714980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ecfcad0609442ac978b2f28869a61a2',ramdisk_id='',reservation_id='r-35vu3dd3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-229465501',owner_user_name='tempest-ServerStableDeviceRescueTest-229465501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:12:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92bb596f4b334418913e5aff74e0cd9b',uuid=2a72dbe6-dfc2-4527-8213-c2e9fe2f553a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Converting VIF {"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:a8:3f,bridge_name='br-int',has_traffic_filtering=True,id=e7070f8b-1a15-4dad-8fac-bd4518007ed3,network=Network(68120f7a-55c5-44f9-8ba2-7b43fb289064),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7070f8b-1a') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG os_vif [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:a8:3f,bridge_name='br-int',has_traffic_filtering=True,id=e7070f8b-1a15-4dad-8fac-bd4518007ed3,network=Network(68120f7a-55c5-44f9-8ba2-7b43fb289064),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7070f8b-1a') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7070f8b-1a, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7070f8b-1a, col_values=(('external_ids', {'iface-id': 'e7070f8b-1a15-4dad-8fac-bd4518007ed3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:a8:3f', 'vm-uuid': '2a72dbe6-dfc2-4527-8213-c2e9fe2f553a'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:48 user nova-compute[73520]: INFO os_vif [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:a8:3f,bridge_name='br-int',has_traffic_filtering=True,id=e7070f8b-1a15-4dad-8fac-bd4518007ed3,network=Network(68120f7a-55c5-44f9-8ba2-7b43fb289064),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7070f8b-1a')
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] No VIF found with MAC fa:16:3e:58:a8:3f, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.network.neutron [req-ed452275-666d-4f44-9378-cd301ba42541 req-9770a791-0450-4ef5-843c-d7c65de8127e service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updated VIF entry in instance network info cache for port ec555ffc-ecb2-48d7-8c11-d07a3238df5a. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG nova.network.neutron [req-ed452275-666d-4f44-9378-cd301ba42541 req-9770a791-0450-4ef5-843c-d7c65de8127e service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updating instance_info_cache with network_info: [{"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:12:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed452275-666d-4f44-9378-cd301ba42541 req-9770a791-0450-4ef5-843c-d7c65de8127e service nova] Releasing lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:12:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:50 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Successfully created port: 8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:12:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:50 user nova-compute[73520]: DEBUG nova.network.neutron [req-59cb1653-bd10-42a5-91d2-b647b6489923 req-723ef661-7283-46b2-b449-e48a42e1486a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updated VIF entry in instance network info cache for port e7070f8b-1a15-4dad-8fac-bd4518007ed3. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:12:50 user nova-compute[73520]: DEBUG nova.network.neutron [req-59cb1653-bd10-42a5-91d2-b647b6489923 req-723ef661-7283-46b2-b449-e48a42e1486a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updating instance_info_cache with network_info: [{"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:12:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-59cb1653-bd10-42a5-91d2-b647b6489923 req-723ef661-7283-46b2-b449-e48a42e1486a service nova] Releasing lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:12:51 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Successfully updated port: 8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:12:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-72ccaa87-cba0-446c-b505-b4da5e91f2a6 req-3cbe9b46-9749-441c-9e36-8b1cf4cfab4c service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Received event network-changed-8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:12:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-72ccaa87-cba0-446c-b505-b4da5e91f2a6 req-3cbe9b46-9749-441c-9e36-8b1cf4cfab4c service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Refreshing instance network info cache due to event network-changed-8752a2b2-4922-4822-ad90-f0a98e749b9f. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:12:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-72ccaa87-cba0-446c-b505-b4da5e91f2a6 req-3cbe9b46-9749-441c-9e36-8b1cf4cfab4c service nova] Acquiring lock "refresh_cache-636510f6-acfa-4705-bfb1-03df3f9297be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:12:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-72ccaa87-cba0-446c-b505-b4da5e91f2a6 req-3cbe9b46-9749-441c-9e36-8b1cf4cfab4c service nova] Acquired lock "refresh_cache-636510f6-acfa-4705-bfb1-03df3f9297be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:12:51 user nova-compute[73520]: DEBUG nova.network.neutron [req-72ccaa87-cba0-446c-b505-b4da5e91f2a6 req-3cbe9b46-9749-441c-9e36-8b1cf4cfab4c service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Refreshing network info cache for port 8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:12:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "refresh_cache-636510f6-acfa-4705-bfb1-03df3f9297be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:12:51 user nova-compute[73520]: DEBUG nova.network.neutron [req-72ccaa87-cba0-446c-b505-b4da5e91f2a6 req-3cbe9b46-9749-441c-9e36-8b1cf4cfab4c service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.network.neutron [req-72ccaa87-cba0-446c-b505-b4da5e91f2a6 req-3cbe9b46-9749-441c-9e36-8b1cf4cfab4c service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692187972.1866732, 443357b7-2fc9-4ac7-8fce-7dc2bede4369 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:12:52 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] VM Resumed (Lifecycle Event)
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-72ccaa87-cba0-446c-b505-b4da5e91f2a6 req-3cbe9b46-9749-441c-9e36-8b1cf4cfab4c service nova] Releasing lock "refresh_cache-636510f6-acfa-4705-bfb1-03df3f9297be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquired lock "refresh_cache-636510f6-acfa-4705-bfb1-03df3f9297be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:12:52 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Instance spawned successfully.
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:52 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692187972.2018192, 443357b7-2fc9-4ac7-8fce-7dc2bede4369 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:12:52 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] VM Started (Lifecycle Event)
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:12:52 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:12:52 user nova-compute[73520]: INFO nova.compute.manager [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Took 11.86 seconds to spawn the instance on the hypervisor.
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:12:52 user nova-compute[73520]: INFO nova.compute.manager [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Took 12.61 seconds to build instance.
Aug 16 12:12:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947a4205-98c0-4980-a2eb-c782a6e3caa7 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.732s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Updating instance_info_cache with network_info: [{"id": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "address": "fa:16:3e:da:67:8e", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8752a2b2-49", "ovs_interfaceid": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Releasing lock "refresh_cache-636510f6-acfa-4705-bfb1-03df3f9297be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Instance network_info: |[{"id": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "address": "fa:16:3e:da:67:8e", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8752a2b2-49", "ovs_interfaceid": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Start _get_guest_xml network_info=[{"id": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "address": "fa:16:3e:da:67:8e", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8752a2b2-49", "ovs_interfaceid": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:12:52 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:12:52 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-889920580',display_name='tempest-AttachVolumeNegativeTest-server-889920580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-889920580',id=4,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU68gMjUMrrFGYyL6G+bCKIrc9K1Hm/bQaeFEEcUHEKz0b7+Nsl04EHx12Pf0ZOjvPRHhA2XGz5Mn8jPbfMUg72MUtAH8VRQHZXPkzxgixcXnCOSzZfft+jgW8lUUNBdQ==',key_name='tempest-keypair-1325007206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1059841e2ee04ca4870497a1ec60bcaa',ramdisk_id='',reservation_id='r-m2e9w7uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1618912538',owner_user_name='tempest-AttachVolumeNegativeTest-1618912538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6426c917725745038fdb1d03fec4a2fd',uuid=636510f6-acfa-4705-bfb1-03df3f9297be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "address": "fa:16:3e:da:67:8e", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8752a2b2-49", "ovs_interfaceid": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converting VIF {"id": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "address": "fa:16:3e:da:67:8e", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8752a2b2-49", "ovs_interfaceid": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:67:8e,bridge_name='br-int',has_traffic_filtering=True,id=8752a2b2-4922-4822-ad90-f0a98e749b9f,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8752a2b2-49') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.objects.instance [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'pci_devices' on Instance uuid 636510f6-acfa-4705-bfb1-03df3f9297be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:12:52 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692187972.9119198, 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:12:52 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] VM Resumed (Lifecycle Event)
Aug 16 12:12:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:12:53 user nova-compute[73520]:   <uuid>636510f6-acfa-4705-bfb1-03df3f9297be</uuid>
Aug 16 12:12:53 user nova-compute[73520]:   <name>instance-00000004</name>
Aug 16 12:12:53 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:12:53 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:12:53 user nova-compute[73520]:   <metadata>
Aug 16 12:12:53 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:12:53 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:12:53 user nova-compute[73520]:       <nova:name>tempest-AttachVolumeNegativeTest-server-889920580</nova:name>
Aug 16 12:12:53 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:12:52</nova:creationTime>
Aug 16 12:12:53 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:12:53 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:12:53 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:12:53 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:12:53 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:12:53 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:12:53 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:12:53 user nova-compute[73520]:       <nova:owner>
Aug 16 12:12:53 user nova-compute[73520]:         <nova:user uuid="6426c917725745038fdb1d03fec4a2fd">tempest-AttachVolumeNegativeTest-1618912538-project-member</nova:user>
Aug 16 12:12:53 user nova-compute[73520]:         <nova:project uuid="1059841e2ee04ca4870497a1ec60bcaa">tempest-AttachVolumeNegativeTest-1618912538</nova:project>
Aug 16 12:12:53 user nova-compute[73520]:       </nova:owner>
Aug 16 12:12:53 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:12:53 user nova-compute[73520]:       <nova:ports>
Aug 16 12:12:53 user nova-compute[73520]:         <nova:port uuid="8752a2b2-4922-4822-ad90-f0a98e749b9f">
Aug 16 12:12:53 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 12:12:53 user nova-compute[73520]:         </nova:port>
Aug 16 12:12:53 user nova-compute[73520]:       </nova:ports>
Aug 16 12:12:53 user nova-compute[73520]:     </nova:instance>
Aug 16 12:12:53 user nova-compute[73520]:   </metadata>
Aug 16 12:12:53 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:12:53 user nova-compute[73520]:     <system>
Aug 16 12:12:53 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:12:53 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:12:53 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:12:53 user nova-compute[73520]:       <entry name="serial">636510f6-acfa-4705-bfb1-03df3f9297be</entry>
Aug 16 12:12:53 user nova-compute[73520]:       <entry name="uuid">636510f6-acfa-4705-bfb1-03df3f9297be</entry>
Aug 16 12:12:53 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:12:53 user nova-compute[73520]:     </system>
Aug 16 12:12:53 user nova-compute[73520]:   </sysinfo>
Aug 16 12:12:53 user nova-compute[73520]:   <os>
Aug 16 12:12:53 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:12:53 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:12:53 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:12:53 user nova-compute[73520]:   </os>
Aug 16 12:12:53 user nova-compute[73520]:   <features>
Aug 16 12:12:53 user nova-compute[73520]:     <acpi/>
Aug 16 12:12:53 user nova-compute[73520]:     <apic/>
Aug 16 12:12:53 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:12:53 user nova-compute[73520]:   </features>
Aug 16 12:12:53 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:12:53 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:12:53 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:12:53 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:12:53 user nova-compute[73520]:   </clock>
Aug 16 12:12:53 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:12:53 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:12:53 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:12:53 user nova-compute[73520]:   </cpu>
Aug 16 12:12:53 user nova-compute[73520]:   <devices>
Aug 16 12:12:53 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:12:53 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:12:53 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk"/>
Aug 16 12:12:53 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:12:53 user nova-compute[73520]:     </disk>
Aug 16 12:12:53 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:12:53 user nova-compute[73520]:       <mac address="fa:16:3e:da:67:8e"/>
Aug 16 12:12:53 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:12:53 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:12:53 user nova-compute[73520]:       <target dev="tap8752a2b2-49"/>
Aug 16 12:12:53 user nova-compute[73520]:     </interface>
Aug 16 12:12:53 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:12:53 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/console.log" append="off"/>
Aug 16 12:12:53 user nova-compute[73520]:     </serial>
Aug 16 12:12:53 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:12:53 user nova-compute[73520]:     <video>
Aug 16 12:12:53 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:12:53 user nova-compute[73520]:     </video>
Aug 16 12:12:53 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:12:53 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:12:53 user nova-compute[73520]:     </rng>
Aug 16 12:12:53 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:12:53 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:12:53 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:12:53 user nova-compute[73520]:     </memballoon>
Aug 16 12:12:53 user nova-compute[73520]:   </devices>
Aug 16 12:12:53 user nova-compute[73520]: </domain>
Aug 16 12:12:53 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-889920580',display_name='tempest-AttachVolumeNegativeTest-server-889920580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-889920580',id=4,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU68gMjUMrrFGYyL6G+bCKIrc9K1Hm/bQaeFEEcUHEKz0b7+Nsl04EHx12Pf0ZOjvPRHhA2XGz5Mn8jPbfMUg72MUtAH8VRQHZXPkzxgixcXnCOSzZfft+jgW8lUUNBdQ==',key_name='tempest-keypair-1325007206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1059841e2ee04ca4870497a1ec60bcaa',ramdisk_id='',reservation_id='r-m2e9w7uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1618912538',owner_user_name='tempest-AttachVolumeNegativeTest-1618912538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6426c917725745038fdb1d03fec4a2fd',uuid=636510f6-acfa-4705-bfb1-03df3f9297be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "address": "fa:16:3e:da:67:8e", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8752a2b2-49", "ovs_interfaceid": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converting VIF {"id": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "address": "fa:16:3e:da:67:8e", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8752a2b2-49", "ovs_interfaceid": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:67:8e,bridge_name='br-int',has_traffic_filtering=True,id=8752a2b2-4922-4822-ad90-f0a98e749b9f,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8752a2b2-49') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG os_vif [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:67:8e,bridge_name='br-int',has_traffic_filtering=True,id=8752a2b2-4922-4822-ad90-f0a98e749b9f,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8752a2b2-49') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8752a2b2-49, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8752a2b2-49, col_values=(('external_ids', {'iface-id': '8752a2b2-4922-4822-ad90-f0a98e749b9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:67:8e', 'vm-uuid': '636510f6-acfa-4705-bfb1-03df3f9297be'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:12:53 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Instance spawned successfully.
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:53 user nova-compute[73520]: INFO os_vif [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:67:8e,bridge_name='br-int',has_traffic_filtering=True,id=8752a2b2-4922-4822-ad90-f0a98e749b9f,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8752a2b2-49')
Aug 16 12:12:53 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692187972.9281788, 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:12:53 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] VM Started (Lifecycle Event)
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No VIF found with MAC fa:16:3e:da:67:8e, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:12:53 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:12:53 user nova-compute[73520]: INFO nova.compute.manager [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Took 13.90 seconds to spawn the instance on the hypervisor.
Aug 16 12:12:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:12:53 user nova-compute[73520]: INFO nova.compute.manager [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Took 14.87 seconds to build instance.
Aug 16 12:12:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-23f31953-2614-4e06-b7bf-3ca1a68f9c68 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:12:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692187978.2633846, 636510f6-acfa-4705-bfb1-03df3f9297be => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:12:58 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] VM Resumed (Lifecycle Event)
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:12:58 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Instance spawned successfully.
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:12:58 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692187978.2699919, 636510f6-acfa-4705-bfb1-03df3f9297be => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:12:58 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] VM Started (Lifecycle Event)
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:12:58 user nova-compute[73520]: INFO nova.compute.manager [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Took 11.52 seconds to spawn the instance on the hypervisor.
Aug 16 12:12:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:12:58 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:12:58 user nova-compute[73520]: INFO nova.compute.manager [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Took 12.63 seconds to build instance.
Aug 16 12:12:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ab1b332c-350a-4aa1-8101-36041faa90ad tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "636510f6-acfa-4705-bfb1-03df3f9297be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.964s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "1e35c753-7af1-4047-ad06-8b5755207b8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:13:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:01 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:13:01 user nova-compute[73520]: INFO nova.compute.claims [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Claim successful on node user
Aug 16 12:13:01 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:13:01 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:13:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:13:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:13:02 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:13:02 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:13:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:13:02 user nova-compute[73520]: DEBUG nova.policy [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb190d4184a94bdd92b148d65dec3956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e448092474d8d85b91b431adf9ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:13:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:13:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:13:02 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Creating image(s)
Aug 16 12:13:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "/opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "/opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.362s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.266s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk 1073741824" returned: 0 in 0.068s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-6628019b-5e6a-47ed-b83d-db11455f0cb4 req-cf53803d-9ec3-4085-8877-a78893e82396 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Received event network-vif-plugged-b98fbde0-e7c2-4038-b436-57567ad76754 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6628019b-5e6a-47ed-b83d-db11455f0cb4 req-cf53803d-9ec3-4085-8877-a78893e82396 service nova] Acquiring lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6628019b-5e6a-47ed-b83d-db11455f0cb4 req-cf53803d-9ec3-4085-8877-a78893e82396 service nova] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6628019b-5e6a-47ed-b83d-db11455f0cb4 req-cf53803d-9ec3-4085-8877-a78893e82396 service nova] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-6628019b-5e6a-47ed-b83d-db11455f0cb4 req-cf53803d-9ec3-4085-8877-a78893e82396 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] No waiting events found dispatching network-vif-plugged-b98fbde0-e7c2-4038-b436-57567ad76754 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:03 user nova-compute[73520]: WARNING nova.compute.manager [req-6628019b-5e6a-47ed-b83d-db11455f0cb4 req-cf53803d-9ec3-4085-8877-a78893e82396 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Received unexpected event network-vif-plugged-b98fbde0-e7c2-4038-b436-57567ad76754 for instance with vm_state active and task_state None.
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.316s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Cannot resize image /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG nova.objects.instance [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lazy-loading 'migration_context' on Instance uuid 1e35c753-7af1-4047-ad06-8b5755207b8e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Ensure instance console log exists: /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:03 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Successfully created port: 9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Successfully updated port: 9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "refresh_cache-1e35c753-7af1-4047-ad06-8b5755207b8e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquired lock "refresh_cache-1e35c753-7af1-4047-ad06-8b5755207b8e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-b9ce2999-fc57-4f8d-82a5-f36a09644fd0 req-7b934798-ff90-4b80-95c0-15a91d4c1719 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Received event network-changed-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-b9ce2999-fc57-4f8d-82a5-f36a09644fd0 req-7b934798-ff90-4b80-95c0-15a91d4c1719 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Refreshing instance network info cache due to event network-changed-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b9ce2999-fc57-4f8d-82a5-f36a09644fd0 req-7b934798-ff90-4b80-95c0-15a91d4c1719 service nova] Acquiring lock "refresh_cache-1e35c753-7af1-4047-ad06-8b5755207b8e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-f6e73f65-a41d-43ac-b86b-d4b453635c9d req-b73ad0b1-7c8b-435b-bac5-76725882d719 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Received event network-vif-plugged-b98fbde0-e7c2-4038-b436-57567ad76754 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f6e73f65-a41d-43ac-b86b-d4b453635c9d req-b73ad0b1-7c8b-435b-bac5-76725882d719 service nova] Acquiring lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f6e73f65-a41d-43ac-b86b-d4b453635c9d req-b73ad0b1-7c8b-435b-bac5-76725882d719 service nova] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f6e73f65-a41d-43ac-b86b-d4b453635c9d req-b73ad0b1-7c8b-435b-bac5-76725882d719 service nova] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-f6e73f65-a41d-43ac-b86b-d4b453635c9d req-b73ad0b1-7c8b-435b-bac5-76725882d719 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] No waiting events found dispatching network-vif-plugged-b98fbde0-e7c2-4038-b436-57567ad76754 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:05 user nova-compute[73520]: WARNING nova.compute.manager [req-f6e73f65-a41d-43ac-b86b-d4b453635c9d req-b73ad0b1-7c8b-435b-bac5-76725882d719 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Received unexpected event network-vif-plugged-b98fbde0-e7c2-4038-b436-57567ad76754 for instance with vm_state active and task_state None.
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Updating instance_info_cache with network_info: [{"id": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "address": "fa:16:3e:1f:c7:00", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9436b2f8-8b", "ovs_interfaceid": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Releasing lock "refresh_cache-1e35c753-7af1-4047-ad06-8b5755207b8e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Instance network_info: |[{"id": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "address": "fa:16:3e:1f:c7:00", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9436b2f8-8b", "ovs_interfaceid": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b9ce2999-fc57-4f8d-82a5-f36a09644fd0 req-7b934798-ff90-4b80-95c0-15a91d4c1719 service nova] Acquired lock "refresh_cache-1e35c753-7af1-4047-ad06-8b5755207b8e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.network.neutron [req-b9ce2999-fc57-4f8d-82a5-f36a09644fd0 req-7b934798-ff90-4b80-95c0-15a91d4c1719 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Refreshing network info cache for port 9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Start _get_guest_xml network_info=[{"id": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "address": "fa:16:3e:1f:c7:00", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9436b2f8-8b", "ovs_interfaceid": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:13:05 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:05 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1449096621',display_name='tempest-VolumesAdminNegativeTest-server-1449096621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1449096621',id=5,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUO6U37UkdUlcpcja9P1QMQWZ/I+GzBbCy8RTsdxB6uyOZ3wSfbapR71JqyCA6v0Kn94AlaeMqTCg9ioX+SLmVcuZxDO1k0S3mnr3qWzyA26b8JyecfWoYWtNSKY8LWeg==',key_name='tempest-keypair-1719862187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='380e448092474d8d85b91b431adf9ee6',ramdisk_id='',reservation_id='r-gsy36rf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1985198008',owner_user_name='tempest-VolumesAdminNegativeTest-1985198008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb190d4184a94bdd92b148d65dec3956',uuid=1e35c753-7af1-4047-ad06-8b5755207b8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "address": "fa:16:3e:1f:c7:00", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9436b2f8-8b", "ovs_interfaceid": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Converting VIF {"id": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "address": "fa:16:3e:1f:c7:00", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9436b2f8-8b", "ovs_interfaceid": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9436b2f8-8b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.objects.instance [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e35c753-7af1-4047-ad06-8b5755207b8e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:13:05 user nova-compute[73520]:   <uuid>1e35c753-7af1-4047-ad06-8b5755207b8e</uuid>
Aug 16 12:13:05 user nova-compute[73520]:   <name>instance-00000005</name>
Aug 16 12:13:05 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:13:05 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:13:05 user nova-compute[73520]:   <metadata>
Aug 16 12:13:05 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:13:05 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:13:05 user nova-compute[73520]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1449096621</nova:name>
Aug 16 12:13:05 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:13:05</nova:creationTime>
Aug 16 12:13:05 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:13:05 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:13:05 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:13:05 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:13:05 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:13:05 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:13:05 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:13:05 user nova-compute[73520]:       <nova:owner>
Aug 16 12:13:05 user nova-compute[73520]:         <nova:user uuid="fb190d4184a94bdd92b148d65dec3956">tempest-VolumesAdminNegativeTest-1985198008-project-member</nova:user>
Aug 16 12:13:05 user nova-compute[73520]:         <nova:project uuid="380e448092474d8d85b91b431adf9ee6">tempest-VolumesAdminNegativeTest-1985198008</nova:project>
Aug 16 12:13:05 user nova-compute[73520]:       </nova:owner>
Aug 16 12:13:05 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:13:05 user nova-compute[73520]:       <nova:ports>
Aug 16 12:13:05 user nova-compute[73520]:         <nova:port uuid="9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2">
Aug 16 12:13:05 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 12:13:05 user nova-compute[73520]:         </nova:port>
Aug 16 12:13:05 user nova-compute[73520]:       </nova:ports>
Aug 16 12:13:05 user nova-compute[73520]:     </nova:instance>
Aug 16 12:13:05 user nova-compute[73520]:   </metadata>
Aug 16 12:13:05 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:13:05 user nova-compute[73520]:     <system>
Aug 16 12:13:05 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:13:05 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:13:05 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:13:05 user nova-compute[73520]:       <entry name="serial">1e35c753-7af1-4047-ad06-8b5755207b8e</entry>
Aug 16 12:13:05 user nova-compute[73520]:       <entry name="uuid">1e35c753-7af1-4047-ad06-8b5755207b8e</entry>
Aug 16 12:13:05 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:13:05 user nova-compute[73520]:     </system>
Aug 16 12:13:05 user nova-compute[73520]:   </sysinfo>
Aug 16 12:13:05 user nova-compute[73520]:   <os>
Aug 16 12:13:05 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:13:05 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:13:05 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:13:05 user nova-compute[73520]:   </os>
Aug 16 12:13:05 user nova-compute[73520]:   <features>
Aug 16 12:13:05 user nova-compute[73520]:     <acpi/>
Aug 16 12:13:05 user nova-compute[73520]:     <apic/>
Aug 16 12:13:05 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:13:05 user nova-compute[73520]:   </features>
Aug 16 12:13:05 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:13:05 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:13:05 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:13:05 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:13:05 user nova-compute[73520]:   </clock>
Aug 16 12:13:05 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:13:05 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:13:05 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:13:05 user nova-compute[73520]:   </cpu>
Aug 16 12:13:05 user nova-compute[73520]:   <devices>
Aug 16 12:13:05 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:13:05 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:13:05 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk"/>
Aug 16 12:13:05 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:13:05 user nova-compute[73520]:     </disk>
Aug 16 12:13:05 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:13:05 user nova-compute[73520]:       <mac address="fa:16:3e:1f:c7:00"/>
Aug 16 12:13:05 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:13:05 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:13:05 user nova-compute[73520]:       <target dev="tap9436b2f8-8b"/>
Aug 16 12:13:05 user nova-compute[73520]:     </interface>
Aug 16 12:13:05 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:13:05 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/console.log" append="off"/>
Aug 16 12:13:05 user nova-compute[73520]:     </serial>
Aug 16 12:13:05 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:13:05 user nova-compute[73520]:     <video>
Aug 16 12:13:05 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:13:05 user nova-compute[73520]:     </video>
Aug 16 12:13:05 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:13:05 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:13:05 user nova-compute[73520]:     </rng>
Aug 16 12:13:05 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:13:05 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:13:05 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:13:05 user nova-compute[73520]:     </memballoon>
Aug 16 12:13:05 user nova-compute[73520]:   </devices>
Aug 16 12:13:05 user nova-compute[73520]: </domain>
Aug 16 12:13:05 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1449096621',display_name='tempest-VolumesAdminNegativeTest-server-1449096621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1449096621',id=5,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUO6U37UkdUlcpcja9P1QMQWZ/I+GzBbCy8RTsdxB6uyOZ3wSfbapR71JqyCA6v0Kn94AlaeMqTCg9ioX+SLmVcuZxDO1k0S3mnr3qWzyA26b8JyecfWoYWtNSKY8LWeg==',key_name='tempest-keypair-1719862187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='380e448092474d8d85b91b431adf9ee6',ramdisk_id='',reservation_id='r-gsy36rf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1985198008',owner_user_name='tempest-VolumesAdminNegativeTest-1985198008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb190d4184a94bdd92b148d65dec3956',uuid=1e35c753-7af1-4047-ad06-8b5755207b8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "address": "fa:16:3e:1f:c7:00", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9436b2f8-8b", "ovs_interfaceid": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Converting VIF {"id": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "address": "fa:16:3e:1f:c7:00", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9436b2f8-8b", "ovs_interfaceid": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9436b2f8-8b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG os_vif [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9436b2f8-8b') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9436b2f8-8b, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9436b2f8-8b, col_values=(('external_ids', {'iface-id': '9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:c7:00', 'vm-uuid': '1e35c753-7af1-4047-ad06-8b5755207b8e'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:13:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:05 user nova-compute[73520]: INFO os_vif [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9436b2f8-8b')
Aug 16 12:13:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:13:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] No VIF found with MAC fa:16:3e:1f:c7:00, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:13:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "4ace588c-2910-477d-a2f1-259bea336e38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "4ace588c-2910-477d-a2f1-259bea336e38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG nova.network.neutron [req-b9ce2999-fc57-4f8d-82a5-f36a09644fd0 req-7b934798-ff90-4b80-95c0-15a91d4c1719 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Updated VIF entry in instance network info cache for port 9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG nova.network.neutron [req-b9ce2999-fc57-4f8d-82a5-f36a09644fd0 req-7b934798-ff90-4b80-95c0-15a91d4c1719 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Updating instance_info_cache with network_info: [{"id": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "address": "fa:16:3e:1f:c7:00", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9436b2f8-8b", "ovs_interfaceid": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b9ce2999-fc57-4f8d-82a5-f36a09644fd0 req-7b934798-ff90-4b80-95c0-15a91d4c1719 service nova] Releasing lock "refresh_cache-1e35c753-7af1-4047-ad06-8b5755207b8e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:13:07 user nova-compute[73520]: INFO nova.compute.claims [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Claim successful on node user
Aug 16 12:13:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:13:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:13:07 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 16 12:13:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG nova.compute.manager [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:13:08 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Creating image(s)
Aug 16 12:13:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "/opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "/opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df.part --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG nova.policy [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0286fa8b7da84be9a0fdea8a09656dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff63ee7d988f4c40a4233d32238331d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df.part --force-share --output=json" returned: 0 in 0.250s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG nova.virt.images [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] a0193d69-19d3-4f14-83dd-e1ef7fd72f94 was qcow2, converting to raw {{(pid=73520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:13:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df.part /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df.converted {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df.part /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df.converted" returned: 0 in 0.284s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df.converted --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.327s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df --force-share --output=json" returned: 0 in 0.213s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:13:09 user nova-compute[73520]: INFO nova.compute.claims [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Claim successful on node user
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df --force-share --output=json" returned: 0 in 0.206s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df,backing_fmt=raw /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df,backing_fmt=raw /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk 1073741824" returned: 0 in 0.086s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:09 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692187989.9650178, 1e35c753-7af1-4047-ad06-8b5755207b8e => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:13:09 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] VM Resumed (Lifecycle Event)
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:10 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Instance spawned successfully.
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:13:10 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692187989.9680269, 1e35c753-7af1-4047-ad06-8b5755207b8e => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:13:10 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] VM Started (Lifecycle Event)
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df --force-share --output=json" returned: 0 in 0.226s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:10 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:13:10 user nova-compute[73520]: INFO nova.compute.manager [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Took 7.77 seconds to spawn the instance on the hypervisor.
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:10 user nova-compute[73520]: INFO nova.compute.manager [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Took 9.18 seconds to build instance.
Aug 16 12:13:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Cannot resize image /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.objects.instance [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lazy-loading 'migration_context' on Instance uuid 4ace588c-2910-477d-a2f1-259bea336e38 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc9c83ba-6df9-409d-9f09-413c81ad7b86 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.581s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.network.neutron [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Successfully created port: d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Ensure instance console log exists: /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.845s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.365s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:13:10 user nova-compute[73520]: INFO nova.compute.claims [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Claim successful on node user
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:13:10 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:13:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG nova.policy [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99cc5165cef34c4e88e8a5632a032892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caab51add8e64f9686ad8f216d138814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:13:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Creating image(s)
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "/opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "/opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.208s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.180s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.172s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk 1073741824" returned: 0 in 0.064s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:13:11 user nova-compute[73520]: DEBUG nova.network.neutron [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:13:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:13:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.205s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG nova.policy [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a805ae6baee474691c122bafeb4281d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c922281e6ebc4d9a94b2f4bed5de8c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:13:12 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Creating image(s)
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "/opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "/opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Cannot resize image /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG nova.objects.instance [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lazy-loading 'migration_context' on Instance uuid 4ce719c9-0210-414f-bbf3-37bfa392125c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Ensure instance console log exists: /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.269s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.276s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk 1073741824" returned: 0 in 0.073s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.220s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Successfully created port: 2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Cannot resize image /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG nova.objects.instance [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lazy-loading 'migration_context' on Instance uuid c1492de2-3545-4ef7-bf3d-07e779d73f8d {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Ensure instance console log exists: /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG nova.network.neutron [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Successfully updated port: d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "refresh_cache-4ace588c-2910-477d-a2f1-259bea336e38" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquired lock "refresh_cache-4ace588c-2910-477d-a2f1-259bea336e38" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG nova.network.neutron [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-5b740a40-29f9-4480-ab04-0bc67a4e1736 req-92c33703-b6f4-4604-98b1-e2990056066b service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Received event network-changed-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-5b740a40-29f9-4480-ab04-0bc67a4e1736 req-92c33703-b6f4-4604-98b1-e2990056066b service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Refreshing instance network info cache due to event network-changed-d1674c7c-7ec6-4ec5-b898-2afd3fcad071. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5b740a40-29f9-4480-ab04-0bc67a4e1736 req-92c33703-b6f4-4604-98b1-e2990056066b service nova] Acquiring lock "refresh_cache-4ace588c-2910-477d-a2f1-259bea336e38" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:13:13 user nova-compute[73520]: DEBUG nova.network.neutron [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.network.neutron [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Updating instance_info_cache with network_info: [{"id": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "address": "fa:16:3e:e8:1c:7e", "network": {"id": "a9472174-9ce5-4cb7-a698-35f03a009863", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-924117371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63ee7d988f4c40a4233d32238331d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1674c7c-7e", "ovs_interfaceid": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.network.neutron [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Successfully created port: 4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Releasing lock "refresh_cache-4ace588c-2910-477d-a2f1-259bea336e38" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Instance network_info: |[{"id": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "address": "fa:16:3e:e8:1c:7e", "network": {"id": "a9472174-9ce5-4cb7-a698-35f03a009863", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-924117371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63ee7d988f4c40a4233d32238331d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1674c7c-7e", "ovs_interfaceid": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5b740a40-29f9-4480-ab04-0bc67a4e1736 req-92c33703-b6f4-4604-98b1-e2990056066b service nova] Acquired lock "refresh_cache-4ace588c-2910-477d-a2f1-259bea336e38" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-5b740a40-29f9-4480-ab04-0bc67a4e1736 req-92c33703-b6f4-4604-98b1-e2990056066b service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Refreshing network info cache for port d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Start _get_guest_xml network_info=[{"id": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "address": "fa:16:3e:e8:1c:7e", "network": {"id": "a9472174-9ce5-4cb7-a698-35f03a009863", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-924117371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63ee7d988f4c40a4233d32238331d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1674c7c-7e", "ovs_interfaceid": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:12:57Z,direct_url=<?>,disk_format='qcow2',id=a0193d69-19d3-4f14-83dd-e1ef7fd72f94,min_disk=0,min_ram=0,name='',owner='514eeba00b0342adaec432a9c30972ba',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:13:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'a0193d69-19d3-4f14-83dd-e1ef7fd72f94'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:13:14 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:14 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:12:57Z,direct_url=<?>,disk_format='qcow2',id=a0193d69-19d3-4f14-83dd-e1ef7fd72f94,min_disk=0,min_ram=0,name='',owner='514eeba00b0342adaec432a9c30972ba',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:13:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1128776314',display_name='tempest-AttachSCSIVolumeTestJSON-server-1128776314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1128776314',id=6,image_ref='a0193d69-19d3-4f14-83dd-e1ef7fd72f94',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYk3E9/H1rqfMrntRWASDDvpP6+7XvAxnmGO38E6/Gs5pyUke6CcqNYk47oDD3m7CziNw8ESyVLYJmKlz60Tpq5gLVZ+klL3vvIzsQM0HjCGlgjNPn2si5TUQjxsmelbg==',key_name='tempest-keypair-1633517254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff63ee7d988f4c40a4233d32238331d0',ramdisk_id='',reservation_id='r-ispiuvwa',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0193d69-19d3-4f14-83dd-e1ef7fd72f94',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-21731701',owner_user_name='tempest-AttachSCSIVolumeTestJSON-21731701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0286fa8b7da84be9a0fdea8a09656dde',uuid=4ace588c-2910-477d-a2f1-259bea336e38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "address": "fa:16:3e:e8:1c:7e", "network": {"id": "a9472174-9ce5-4cb7-a698-35f03a009863", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-924117371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63ee7d988f4c40a4233d32238331d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1674c7c-7e", "ovs_interfaceid": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Converting VIF {"id": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "address": "fa:16:3e:e8:1c:7e", "network": {"id": "a9472174-9ce5-4cb7-a698-35f03a009863", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-924117371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63ee7d988f4c40a4233d32238331d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1674c7c-7e", "ovs_interfaceid": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d1674c7c-7ec6-4ec5-b898-2afd3fcad071,network=Network(a9472174-9ce5-4cb7-a698-35f03a009863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1674c7c-7e') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.objects.instance [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ace588c-2910-477d-a2f1-259bea336e38 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:13:14 user nova-compute[73520]:   <uuid>4ace588c-2910-477d-a2f1-259bea336e38</uuid>
Aug 16 12:13:14 user nova-compute[73520]:   <name>instance-00000006</name>
Aug 16 12:13:14 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:13:14 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:13:14 user nova-compute[73520]:   <metadata>
Aug 16 12:13:14 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:13:14 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:13:14 user nova-compute[73520]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1128776314</nova:name>
Aug 16 12:13:14 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:13:14</nova:creationTime>
Aug 16 12:13:14 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:13:14 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:13:14 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:13:14 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:13:14 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:13:14 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:13:14 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:13:14 user nova-compute[73520]:       <nova:owner>
Aug 16 12:13:14 user nova-compute[73520]:         <nova:user uuid="0286fa8b7da84be9a0fdea8a09656dde">tempest-AttachSCSIVolumeTestJSON-21731701-project-member</nova:user>
Aug 16 12:13:14 user nova-compute[73520]:         <nova:project uuid="ff63ee7d988f4c40a4233d32238331d0">tempest-AttachSCSIVolumeTestJSON-21731701</nova:project>
Aug 16 12:13:14 user nova-compute[73520]:       </nova:owner>
Aug 16 12:13:14 user nova-compute[73520]:       <nova:root type="image" uuid="a0193d69-19d3-4f14-83dd-e1ef7fd72f94"/>
Aug 16 12:13:14 user nova-compute[73520]:       <nova:ports>
Aug 16 12:13:14 user nova-compute[73520]:         <nova:port uuid="d1674c7c-7ec6-4ec5-b898-2afd3fcad071">
Aug 16 12:13:14 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 12:13:14 user nova-compute[73520]:         </nova:port>
Aug 16 12:13:14 user nova-compute[73520]:       </nova:ports>
Aug 16 12:13:14 user nova-compute[73520]:     </nova:instance>
Aug 16 12:13:14 user nova-compute[73520]:   </metadata>
Aug 16 12:13:14 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:13:14 user nova-compute[73520]:     <system>
Aug 16 12:13:14 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:13:14 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:13:14 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:13:14 user nova-compute[73520]:       <entry name="serial">4ace588c-2910-477d-a2f1-259bea336e38</entry>
Aug 16 12:13:14 user nova-compute[73520]:       <entry name="uuid">4ace588c-2910-477d-a2f1-259bea336e38</entry>
Aug 16 12:13:14 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:13:14 user nova-compute[73520]:     </system>
Aug 16 12:13:14 user nova-compute[73520]:   </sysinfo>
Aug 16 12:13:14 user nova-compute[73520]:   <os>
Aug 16 12:13:14 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:13:14 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:13:14 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:13:14 user nova-compute[73520]:   </os>
Aug 16 12:13:14 user nova-compute[73520]:   <features>
Aug 16 12:13:14 user nova-compute[73520]:     <acpi/>
Aug 16 12:13:14 user nova-compute[73520]:     <apic/>
Aug 16 12:13:14 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:13:14 user nova-compute[73520]:   </features>
Aug 16 12:13:14 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:13:14 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:13:14 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:13:14 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:13:14 user nova-compute[73520]:   </clock>
Aug 16 12:13:14 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:13:14 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:13:14 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:13:14 user nova-compute[73520]:   </cpu>
Aug 16 12:13:14 user nova-compute[73520]:   <devices>
Aug 16 12:13:14 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:13:14 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:13:14 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk"/>
Aug 16 12:13:14 user nova-compute[73520]:       <target dev="sda" bus="scsi"/>
Aug 16 12:13:14 user nova-compute[73520]:       <address type="drive" controller="0" unit="0"/>
Aug 16 12:13:14 user nova-compute[73520]:     </disk>
Aug 16 12:13:14 user nova-compute[73520]:     <disk type="file" device="cdrom">
Aug 16 12:13:14 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 12:13:14 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk.config"/>
Aug 16 12:13:14 user nova-compute[73520]:       <target dev="sdb" bus="scsi"/>
Aug 16 12:13:14 user nova-compute[73520]:       <address type="drive" controller="0" unit="1"/>
Aug 16 12:13:14 user nova-compute[73520]:     </disk>
Aug 16 12:13:14 user nova-compute[73520]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 16 12:13:14 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:13:14 user nova-compute[73520]:       <mac address="fa:16:3e:e8:1c:7e"/>
Aug 16 12:13:14 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:13:14 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:13:14 user nova-compute[73520]:       <target dev="tapd1674c7c-7e"/>
Aug 16 12:13:14 user nova-compute[73520]:     </interface>
Aug 16 12:13:14 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:13:14 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/console.log" append="off"/>
Aug 16 12:13:14 user nova-compute[73520]:     </serial>
Aug 16 12:13:14 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:13:14 user nova-compute[73520]:     <video>
Aug 16 12:13:14 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:13:14 user nova-compute[73520]:     </video>
Aug 16 12:13:14 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:13:14 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:13:14 user nova-compute[73520]:     </rng>
Aug 16 12:13:14 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:13:14 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:13:14 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:13:14 user nova-compute[73520]:     </memballoon>
Aug 16 12:13:14 user nova-compute[73520]:   </devices>
Aug 16 12:13:14 user nova-compute[73520]: </domain>
Aug 16 12:13:14 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1128776314',display_name='tempest-AttachSCSIVolumeTestJSON-server-1128776314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1128776314',id=6,image_ref='a0193d69-19d3-4f14-83dd-e1ef7fd72f94',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYk3E9/H1rqfMrntRWASDDvpP6+7XvAxnmGO38E6/Gs5pyUke6CcqNYk47oDD3m7CziNw8ESyVLYJmKlz60Tpq5gLVZ+klL3vvIzsQM0HjCGlgjNPn2si5TUQjxsmelbg==',key_name='tempest-keypair-1633517254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff63ee7d988f4c40a4233d32238331d0',ramdisk_id='',reservation_id='r-ispiuvwa',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0193d69-19d3-4f14-83dd-e1ef7fd72f94',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-21731701',owner_user_name='tempest-AttachSCSIVolumeTestJSON-21731701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0286fa8b7da84be9a0fdea8a09656dde',uuid=4ace588c-2910-477d-a2f1-259bea336e38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "address": "fa:16:3e:e8:1c:7e", "network": {"id": "a9472174-9ce5-4cb7-a698-35f03a009863", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-924117371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63ee7d988f4c40a4233d32238331d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1674c7c-7e", "ovs_interfaceid": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Converting VIF {"id": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "address": "fa:16:3e:e8:1c:7e", "network": {"id": "a9472174-9ce5-4cb7-a698-35f03a009863", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-924117371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63ee7d988f4c40a4233d32238331d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1674c7c-7e", "ovs_interfaceid": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d1674c7c-7ec6-4ec5-b898-2afd3fcad071,network=Network(a9472174-9ce5-4cb7-a698-35f03a009863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1674c7c-7e') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG os_vif [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d1674c7c-7ec6-4ec5-b898-2afd3fcad071,network=Network(a9472174-9ce5-4cb7-a698-35f03a009863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1674c7c-7e') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1674c7c-7e, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1674c7c-7e, col_values=(('external_ids', {'iface-id': 'd1674c7c-7ec6-4ec5-b898-2afd3fcad071', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:1c:7e', 'vm-uuid': '4ace588c-2910-477d-a2f1-259bea336e38'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:14 user nova-compute[73520]: INFO os_vif [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d1674c7c-7ec6-4ec5-b898-2afd3fcad071,network=Network(a9472174-9ce5-4cb7-a698-35f03a009863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1674c7c-7e')
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Successfully updated port: 2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] No BDM found with device name sda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] No VIF found with MAC fa:16:3e:e8:1c:7e, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:13:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Using config drive
Aug 16 12:13:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Acquiring lock "refresh_cache-4ce719c9-0210-414f-bbf3-37bfa392125c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Acquired lock "refresh_cache-4ce719c9-0210-414f-bbf3-37bfa392125c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-22c2a99c-f2bd-4407-93af-2c57758c9c6c req-d802b860-e8a9-46e5-a600-b2846e913e7d service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received event network-changed-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-22c2a99c-f2bd-4407-93af-2c57758c9c6c req-d802b860-e8a9-46e5-a600-b2846e913e7d service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Refreshing instance network info cache due to event network-changed-2afb34f7-7b7d-443d-981f-6ef40dd67a0c. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:13:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-22c2a99c-f2bd-4407-93af-2c57758c9c6c req-d802b860-e8a9-46e5-a600-b2846e913e7d service nova] Acquiring lock "refresh_cache-4ce719c9-0210-414f-bbf3-37bfa392125c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:13:15 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Creating config drive at /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk.config
Aug 16 12:13:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprkixeprl {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprkixeprl" returned: 0 in 0.059s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Updating instance_info_cache with network_info: [{"id": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "address": "fa:16:3e:1d:41:db", "network": {"id": "ec26c36e-9fe5-4056-8714-2fbb92d9b4cc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-795728958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caab51add8e64f9686ad8f216d138814", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afb34f7-7b", "ovs_interfaceid": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Releasing lock "refresh_cache-4ce719c9-0210-414f-bbf3-37bfa392125c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Instance network_info: |[{"id": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "address": "fa:16:3e:1d:41:db", "network": {"id": "ec26c36e-9fe5-4056-8714-2fbb92d9b4cc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-795728958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caab51add8e64f9686ad8f216d138814", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afb34f7-7b", "ovs_interfaceid": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-22c2a99c-f2bd-4407-93af-2c57758c9c6c req-d802b860-e8a9-46e5-a600-b2846e913e7d service nova] Acquired lock "refresh_cache-4ce719c9-0210-414f-bbf3-37bfa392125c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.network.neutron [req-22c2a99c-f2bd-4407-93af-2c57758c9c6c req-d802b860-e8a9-46e5-a600-b2846e913e7d service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Refreshing network info cache for port 2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Start _get_guest_xml network_info=[{"id": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "address": "fa:16:3e:1d:41:db", "network": {"id": "ec26c36e-9fe5-4056-8714-2fbb92d9b4cc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-795728958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caab51add8e64f9686ad8f216d138814", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afb34f7-7b", "ovs_interfaceid": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:13:15 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:15 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1660001176',display_name='tempest-VolumesAssistedSnapshotsTest-server-1660001176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1660001176',id=7,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNUB8K29acWrdDRIOhv2ywmN1na0C9uF/CNyco6X+4iz8wkv5svzXvkhGCmgrrX3HYdcWP1DNRvn2GFuuJmwk5OZ7Bhku0Pp9v8aQXvnKnPkjPf+FI8SEEKVNsHTraAHA==',key_name='tempest-keypair-248214497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caab51add8e64f9686ad8f216d138814',ramdisk_id='',reservation_id='r-0w3c3hqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-357758320',owner_user_name='tempest-VolumesAssistedSnapshotsTest-357758320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99cc5165cef34c4e88e8a5632a032892',uuid=4ce719c9-0210-414f-bbf3-37bfa392125c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "address": "fa:16:3e:1d:41:db", "network": {"id": "ec26c36e-9fe5-4056-8714-2fbb92d9b4cc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-795728958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caab51add8e64f9686ad8f216d138814", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afb34f7-7b", "ovs_interfaceid": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Converting VIF {"id": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "address": "fa:16:3e:1d:41:db", "network": {"id": "ec26c36e-9fe5-4056-8714-2fbb92d9b4cc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-795728958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caab51add8e64f9686ad8f216d138814", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afb34f7-7b", "ovs_interfaceid": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:41:db,bridge_name='br-int',has_traffic_filtering=True,id=2afb34f7-7b7d-443d-981f-6ef40dd67a0c,network=Network(ec26c36e-9fe5-4056-8714-2fbb92d9b4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afb34f7-7b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.objects.instance [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ce719c9-0210-414f-bbf3-37bfa392125c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:13:15 user nova-compute[73520]:   <uuid>4ce719c9-0210-414f-bbf3-37bfa392125c</uuid>
Aug 16 12:13:15 user nova-compute[73520]:   <name>instance-00000007</name>
Aug 16 12:13:15 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:13:15 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:13:15 user nova-compute[73520]:   <metadata>
Aug 16 12:13:15 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:13:15 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:13:15 user nova-compute[73520]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1660001176</nova:name>
Aug 16 12:13:15 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:13:15</nova:creationTime>
Aug 16 12:13:15 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:13:15 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:13:15 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:13:15 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:13:15 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:13:15 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:13:15 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:13:15 user nova-compute[73520]:       <nova:owner>
Aug 16 12:13:15 user nova-compute[73520]:         <nova:user uuid="99cc5165cef34c4e88e8a5632a032892">tempest-VolumesAssistedSnapshotsTest-357758320-project-member</nova:user>
Aug 16 12:13:15 user nova-compute[73520]:         <nova:project uuid="caab51add8e64f9686ad8f216d138814">tempest-VolumesAssistedSnapshotsTest-357758320</nova:project>
Aug 16 12:13:15 user nova-compute[73520]:       </nova:owner>
Aug 16 12:13:15 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:13:15 user nova-compute[73520]:       <nova:ports>
Aug 16 12:13:15 user nova-compute[73520]:         <nova:port uuid="2afb34f7-7b7d-443d-981f-6ef40dd67a0c">
Aug 16 12:13:15 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 12:13:15 user nova-compute[73520]:         </nova:port>
Aug 16 12:13:15 user nova-compute[73520]:       </nova:ports>
Aug 16 12:13:15 user nova-compute[73520]:     </nova:instance>
Aug 16 12:13:15 user nova-compute[73520]:   </metadata>
Aug 16 12:13:15 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:13:15 user nova-compute[73520]:     <system>
Aug 16 12:13:15 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:13:15 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:13:15 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:13:15 user nova-compute[73520]:       <entry name="serial">4ce719c9-0210-414f-bbf3-37bfa392125c</entry>
Aug 16 12:13:15 user nova-compute[73520]:       <entry name="uuid">4ce719c9-0210-414f-bbf3-37bfa392125c</entry>
Aug 16 12:13:15 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:13:15 user nova-compute[73520]:     </system>
Aug 16 12:13:15 user nova-compute[73520]:   </sysinfo>
Aug 16 12:13:15 user nova-compute[73520]:   <os>
Aug 16 12:13:15 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:13:15 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:13:15 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:13:15 user nova-compute[73520]:   </os>
Aug 16 12:13:15 user nova-compute[73520]:   <features>
Aug 16 12:13:15 user nova-compute[73520]:     <acpi/>
Aug 16 12:13:15 user nova-compute[73520]:     <apic/>
Aug 16 12:13:15 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:13:15 user nova-compute[73520]:   </features>
Aug 16 12:13:15 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:13:15 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:13:15 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:13:15 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:13:15 user nova-compute[73520]:   </clock>
Aug 16 12:13:15 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:13:15 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:13:15 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:13:15 user nova-compute[73520]:   </cpu>
Aug 16 12:13:15 user nova-compute[73520]:   <devices>
Aug 16 12:13:15 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:13:15 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:13:15 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk"/>
Aug 16 12:13:15 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:13:15 user nova-compute[73520]:     </disk>
Aug 16 12:13:15 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:13:15 user nova-compute[73520]:       <mac address="fa:16:3e:1d:41:db"/>
Aug 16 12:13:15 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:13:15 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:13:15 user nova-compute[73520]:       <target dev="tap2afb34f7-7b"/>
Aug 16 12:13:15 user nova-compute[73520]:     </interface>
Aug 16 12:13:15 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:13:15 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/console.log" append="off"/>
Aug 16 12:13:15 user nova-compute[73520]:     </serial>
Aug 16 12:13:15 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:13:15 user nova-compute[73520]:     <video>
Aug 16 12:13:15 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:13:15 user nova-compute[73520]:     </video>
Aug 16 12:13:15 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:13:15 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:13:15 user nova-compute[73520]:     </rng>
Aug 16 12:13:15 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:13:15 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:13:15 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:13:15 user nova-compute[73520]:     </memballoon>
Aug 16 12:13:15 user nova-compute[73520]:   </devices>
Aug 16 12:13:15 user nova-compute[73520]: </domain>
Aug 16 12:13:15 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1660001176',display_name='tempest-VolumesAssistedSnapshotsTest-server-1660001176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1660001176',id=7,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNUB8K29acWrdDRIOhv2ywmN1na0C9uF/CNyco6X+4iz8wkv5svzXvkhGCmgrrX3HYdcWP1DNRvn2GFuuJmwk5OZ7Bhku0Pp9v8aQXvnKnPkjPf+FI8SEEKVNsHTraAHA==',key_name='tempest-keypair-248214497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caab51add8e64f9686ad8f216d138814',ramdisk_id='',reservation_id='r-0w3c3hqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-357758320',owner_user_name='tempest-VolumesAssistedSnapshotsTest-357758320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99cc5165cef34c4e88e8a5632a032892',uuid=4ce719c9-0210-414f-bbf3-37bfa392125c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "address": "fa:16:3e:1d:41:db", "network": {"id": "ec26c36e-9fe5-4056-8714-2fbb92d9b4cc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-795728958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caab51add8e64f9686ad8f216d138814", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afb34f7-7b", "ovs_interfaceid": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Converting VIF {"id": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "address": "fa:16:3e:1d:41:db", "network": {"id": "ec26c36e-9fe5-4056-8714-2fbb92d9b4cc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-795728958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caab51add8e64f9686ad8f216d138814", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afb34f7-7b", "ovs_interfaceid": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:41:db,bridge_name='br-int',has_traffic_filtering=True,id=2afb34f7-7b7d-443d-981f-6ef40dd67a0c,network=Network(ec26c36e-9fe5-4056-8714-2fbb92d9b4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afb34f7-7b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG os_vif [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:41:db,bridge_name='br-int',has_traffic_filtering=True,id=2afb34f7-7b7d-443d-981f-6ef40dd67a0c,network=Network(ec26c36e-9fe5-4056-8714-2fbb92d9b4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afb34f7-7b') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2afb34f7-7b, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2afb34f7-7b, col_values=(('external_ids', {'iface-id': '2afb34f7-7b7d-443d-981f-6ef40dd67a0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:41:db', 'vm-uuid': '4ce719c9-0210-414f-bbf3-37bfa392125c'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:15 user nova-compute[73520]: INFO os_vif [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:41:db,bridge_name='br-int',has_traffic_filtering=True,id=2afb34f7-7b7d-443d-981f-6ef40dd67a0c,network=Network(ec26c36e-9fe5-4056-8714-2fbb92d9b4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afb34f7-7b')
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-f4bc6d2e-db98-41b9-b830-2a833ce974e0 req-64bcca9f-a8a8-4bf9-a867-6bc2bb695eab service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Received event network-vif-plugged-ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f4bc6d2e-db98-41b9-b830-2a833ce974e0 req-64bcca9f-a8a8-4bf9-a867-6bc2bb695eab service nova] Acquiring lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f4bc6d2e-db98-41b9-b830-2a833ce974e0 req-64bcca9f-a8a8-4bf9-a867-6bc2bb695eab service nova] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f4bc6d2e-db98-41b9-b830-2a833ce974e0 req-64bcca9f-a8a8-4bf9-a867-6bc2bb695eab service nova] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-f4bc6d2e-db98-41b9-b830-2a833ce974e0 req-64bcca9f-a8a8-4bf9-a867-6bc2bb695eab service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] No waiting events found dispatching network-vif-plugged-ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:15 user nova-compute[73520]: WARNING nova.compute.manager [req-f4bc6d2e-db98-41b9-b830-2a833ce974e0 req-64bcca9f-a8a8-4bf9-a867-6bc2bb695eab service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Received unexpected event network-vif-plugged-ec555ffc-ecb2-48d7-8c11-d07a3238df5a for instance with vm_state active and task_state None.
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:13:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] No VIF found with MAC fa:16:3e:1d:41:db, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:13:16 user nova-compute[73520]: DEBUG nova.network.neutron [req-22c2a99c-f2bd-4407-93af-2c57758c9c6c req-d802b860-e8a9-46e5-a600-b2846e913e7d service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Updated VIF entry in instance network info cache for port 2afb34f7-7b7d-443d-981f-6ef40dd67a0c. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:13:16 user nova-compute[73520]: DEBUG nova.network.neutron [req-22c2a99c-f2bd-4407-93af-2c57758c9c6c req-d802b860-e8a9-46e5-a600-b2846e913e7d service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Updating instance_info_cache with network_info: [{"id": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "address": "fa:16:3e:1d:41:db", "network": {"id": "ec26c36e-9fe5-4056-8714-2fbb92d9b4cc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-795728958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caab51add8e64f9686ad8f216d138814", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afb34f7-7b", "ovs_interfaceid": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:13:16 user nova-compute[73520]: DEBUG nova.network.neutron [req-5b740a40-29f9-4480-ab04-0bc67a4e1736 req-92c33703-b6f4-4604-98b1-e2990056066b service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Updated VIF entry in instance network info cache for port d1674c7c-7ec6-4ec5-b898-2afd3fcad071. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:13:16 user nova-compute[73520]: DEBUG nova.network.neutron [req-5b740a40-29f9-4480-ab04-0bc67a4e1736 req-92c33703-b6f4-4604-98b1-e2990056066b service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Updating instance_info_cache with network_info: [{"id": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "address": "fa:16:3e:e8:1c:7e", "network": {"id": "a9472174-9ce5-4cb7-a698-35f03a009863", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-924117371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63ee7d988f4c40a4233d32238331d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1674c7c-7e", "ovs_interfaceid": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:13:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-22c2a99c-f2bd-4407-93af-2c57758c9c6c req-d802b860-e8a9-46e5-a600-b2846e913e7d service nova] Releasing lock "refresh_cache-4ce719c9-0210-414f-bbf3-37bfa392125c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:13:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5b740a40-29f9-4480-ab04-0bc67a4e1736 req-92c33703-b6f4-4604-98b1-e2990056066b service nova] Releasing lock "refresh_cache-4ace588c-2910-477d-a2f1-259bea336e38" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Successfully updated port: 4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "refresh_cache-c1492de2-3545-4ef7-bf3d-07e779d73f8d" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquired lock "refresh_cache-c1492de2-3545-4ef7-bf3d-07e779d73f8d" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Updating instance_info_cache with network_info: [{"id": "4512d351-5628-4309-990f-dff795735e3c", "address": "fa:16:3e:4b:49:90", "network": {"id": "7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-954407765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c922281e6ebc4d9a94b2f4bed5de8c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4512d351-56", "ovs_interfaceid": "4512d351-5628-4309-990f-dff795735e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Releasing lock "refresh_cache-c1492de2-3545-4ef7-bf3d-07e779d73f8d" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Instance network_info: |[{"id": "4512d351-5628-4309-990f-dff795735e3c", "address": "fa:16:3e:4b:49:90", "network": {"id": "7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-954407765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c922281e6ebc4d9a94b2f4bed5de8c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4512d351-56", "ovs_interfaceid": "4512d351-5628-4309-990f-dff795735e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Start _get_guest_xml network_info=[{"id": "4512d351-5628-4309-990f-dff795735e3c", "address": "fa:16:3e:4b:49:90", "network": {"id": "7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-954407765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c922281e6ebc4d9a94b2f4bed5de8c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4512d351-56", "ovs_interfaceid": "4512d351-5628-4309-990f-dff795735e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:13:17 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:17 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1467733343',display_name='tempest-TestVolumeSwap-server-1467733343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1467733343',id=8,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqMjvh9FEAY/6eTNhd+QmbI8M6gvMJWNxKj1zvkoJMwV2mwoLaLIeEXbk9s1tCLroA6f5FwBHrsRnEV5D0Ykt5S0swbDyD1aBMJke1WyAkAl5XpC4L5rGbrfxLGluO4Tw==',key_name='tempest-keypair-1812386384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c922281e6ebc4d9a94b2f4bed5de8c60',ramdisk_id='',reservation_id='r-vus97gae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-657380562',owner_user_name='tempest-TestVolumeSwap-657380562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a805ae6baee474691c122bafeb4281d',uuid=c1492de2-3545-4ef7-bf3d-07e779d73f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4512d351-5628-4309-990f-dff795735e3c", "address": "fa:16:3e:4b:49:90", "network": {"id": "7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-954407765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c922281e6ebc4d9a94b2f4bed5de8c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4512d351-56", "ovs_interfaceid": "4512d351-5628-4309-990f-dff795735e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Converting VIF {"id": "4512d351-5628-4309-990f-dff795735e3c", "address": "fa:16:3e:4b:49:90", "network": {"id": "7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-954407765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c922281e6ebc4d9a94b2f4bed5de8c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4512d351-56", "ovs_interfaceid": "4512d351-5628-4309-990f-dff795735e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:49:90,bridge_name='br-int',has_traffic_filtering=True,id=4512d351-5628-4309-990f-dff795735e3c,network=Network(7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4512d351-56') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.objects.instance [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lazy-loading 'pci_devices' on Instance uuid c1492de2-3545-4ef7-bf3d-07e779d73f8d {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:13:17 user nova-compute[73520]:   <uuid>c1492de2-3545-4ef7-bf3d-07e779d73f8d</uuid>
Aug 16 12:13:17 user nova-compute[73520]:   <name>instance-00000008</name>
Aug 16 12:13:17 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:13:17 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:13:17 user nova-compute[73520]:   <metadata>
Aug 16 12:13:17 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:13:17 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:13:17 user nova-compute[73520]:       <nova:name>tempest-TestVolumeSwap-server-1467733343</nova:name>
Aug 16 12:13:17 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:13:17</nova:creationTime>
Aug 16 12:13:17 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:13:17 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:13:17 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:13:17 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:13:17 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:13:17 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:13:17 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:13:17 user nova-compute[73520]:       <nova:owner>
Aug 16 12:13:17 user nova-compute[73520]:         <nova:user uuid="3a805ae6baee474691c122bafeb4281d">tempest-TestVolumeSwap-657380562-project-member</nova:user>
Aug 16 12:13:17 user nova-compute[73520]:         <nova:project uuid="c922281e6ebc4d9a94b2f4bed5de8c60">tempest-TestVolumeSwap-657380562</nova:project>
Aug 16 12:13:17 user nova-compute[73520]:       </nova:owner>
Aug 16 12:13:17 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:13:17 user nova-compute[73520]:       <nova:ports>
Aug 16 12:13:17 user nova-compute[73520]:         <nova:port uuid="4512d351-5628-4309-990f-dff795735e3c">
Aug 16 12:13:17 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 12:13:17 user nova-compute[73520]:         </nova:port>
Aug 16 12:13:17 user nova-compute[73520]:       </nova:ports>
Aug 16 12:13:17 user nova-compute[73520]:     </nova:instance>
Aug 16 12:13:17 user nova-compute[73520]:   </metadata>
Aug 16 12:13:17 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:13:17 user nova-compute[73520]:     <system>
Aug 16 12:13:17 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:13:17 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:13:17 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:13:17 user nova-compute[73520]:       <entry name="serial">c1492de2-3545-4ef7-bf3d-07e779d73f8d</entry>
Aug 16 12:13:17 user nova-compute[73520]:       <entry name="uuid">c1492de2-3545-4ef7-bf3d-07e779d73f8d</entry>
Aug 16 12:13:17 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:13:17 user nova-compute[73520]:     </system>
Aug 16 12:13:17 user nova-compute[73520]:   </sysinfo>
Aug 16 12:13:17 user nova-compute[73520]:   <os>
Aug 16 12:13:17 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:13:17 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:13:17 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:13:17 user nova-compute[73520]:   </os>
Aug 16 12:13:17 user nova-compute[73520]:   <features>
Aug 16 12:13:17 user nova-compute[73520]:     <acpi/>
Aug 16 12:13:17 user nova-compute[73520]:     <apic/>
Aug 16 12:13:17 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:13:17 user nova-compute[73520]:   </features>
Aug 16 12:13:17 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:13:17 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:13:17 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:13:17 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:13:17 user nova-compute[73520]:   </clock>
Aug 16 12:13:17 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:13:17 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:13:17 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:13:17 user nova-compute[73520]:   </cpu>
Aug 16 12:13:17 user nova-compute[73520]:   <devices>
Aug 16 12:13:17 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:13:17 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:13:17 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk"/>
Aug 16 12:13:17 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:13:17 user nova-compute[73520]:     </disk>
Aug 16 12:13:17 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:13:17 user nova-compute[73520]:       <mac address="fa:16:3e:4b:49:90"/>
Aug 16 12:13:17 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:13:17 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:13:17 user nova-compute[73520]:       <target dev="tap4512d351-56"/>
Aug 16 12:13:17 user nova-compute[73520]:     </interface>
Aug 16 12:13:17 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:13:17 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/console.log" append="off"/>
Aug 16 12:13:17 user nova-compute[73520]:     </serial>
Aug 16 12:13:17 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:13:17 user nova-compute[73520]:     <video>
Aug 16 12:13:17 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:13:17 user nova-compute[73520]:     </video>
Aug 16 12:13:17 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:13:17 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:13:17 user nova-compute[73520]:     </rng>
Aug 16 12:13:17 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:13:17 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:13:17 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:13:17 user nova-compute[73520]:     </memballoon>
Aug 16 12:13:17 user nova-compute[73520]:   </devices>
Aug 16 12:13:17 user nova-compute[73520]: </domain>
Aug 16 12:13:17 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1467733343',display_name='tempest-TestVolumeSwap-server-1467733343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1467733343',id=8,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqMjvh9FEAY/6eTNhd+QmbI8M6gvMJWNxKj1zvkoJMwV2mwoLaLIeEXbk9s1tCLroA6f5FwBHrsRnEV5D0Ykt5S0swbDyD1aBMJke1WyAkAl5XpC4L5rGbrfxLGluO4Tw==',key_name='tempest-keypair-1812386384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c922281e6ebc4d9a94b2f4bed5de8c60',ramdisk_id='',reservation_id='r-vus97gae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-657380562',owner_user_name='tempest-TestVolumeSwap-657380562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a805ae6baee474691c122bafeb4281d',uuid=c1492de2-3545-4ef7-bf3d-07e779d73f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4512d351-5628-4309-990f-dff795735e3c", "address": "fa:16:3e:4b:49:90", "network": {"id": "7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-954407765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c922281e6ebc4d9a94b2f4bed5de8c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4512d351-56", "ovs_interfaceid": "4512d351-5628-4309-990f-dff795735e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Converting VIF {"id": "4512d351-5628-4309-990f-dff795735e3c", "address": "fa:16:3e:4b:49:90", "network": {"id": "7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-954407765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c922281e6ebc4d9a94b2f4bed5de8c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4512d351-56", "ovs_interfaceid": "4512d351-5628-4309-990f-dff795735e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:49:90,bridge_name='br-int',has_traffic_filtering=True,id=4512d351-5628-4309-990f-dff795735e3c,network=Network(7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4512d351-56') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG os_vif [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:49:90,bridge_name='br-int',has_traffic_filtering=True,id=4512d351-5628-4309-990f-dff795735e3c,network=Network(7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4512d351-56') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4512d351-56, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4512d351-56, col_values=(('external_ids', {'iface-id': '4512d351-5628-4309-990f-dff795735e3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:49:90', 'vm-uuid': 'c1492de2-3545-4ef7-bf3d-07e779d73f8d'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:18 user nova-compute[73520]: INFO os_vif [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:49:90,bridge_name='br-int',has_traffic_filtering=True,id=4512d351-5628-4309-990f-dff795735e3c,network=Network(7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4512d351-56')
Aug 16 12:13:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] No VIF found with MAC fa:16:3e:4b:49:90, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Received event network-vif-plugged-ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] Acquiring lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] No waiting events found dispatching network-vif-plugged-ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:18 user nova-compute[73520]: WARNING nova.compute.manager [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Received unexpected event network-vif-plugged-ec555ffc-ecb2-48d7-8c11-d07a3238df5a for instance with vm_state active and task_state None.
Aug 16 12:13:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] No waiting events found dispatching network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:18 user nova-compute[73520]: WARNING nova.compute.manager [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received unexpected event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 for instance with vm_state active and task_state None.
Aug 16 12:13:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Received event network-changed-4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Refreshing instance network info cache due to event network-changed-4512d351-5628-4309-990f-dff795735e3c. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] Acquiring lock "refresh_cache-c1492de2-3545-4ef7-bf3d-07e779d73f8d" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] Acquired lock "refresh_cache-c1492de2-3545-4ef7-bf3d-07e779d73f8d" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG nova.network.neutron [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Refreshing network info cache for port 4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:19 user nova-compute[73520]: DEBUG nova.network.neutron [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Updated VIF entry in instance network info cache for port 4512d351-5628-4309-990f-dff795735e3c. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:13:19 user nova-compute[73520]: DEBUG nova.network.neutron [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Updating instance_info_cache with network_info: [{"id": "4512d351-5628-4309-990f-dff795735e3c", "address": "fa:16:3e:4b:49:90", "network": {"id": "7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-954407765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c922281e6ebc4d9a94b2f4bed5de8c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4512d351-56", "ovs_interfaceid": "4512d351-5628-4309-990f-dff795735e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:13:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] Releasing lock "refresh_cache-c1492de2-3545-4ef7-bf3d-07e779d73f8d" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:13:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] No waiting events found dispatching network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:19 user nova-compute[73520]: WARNING nova.compute.manager [req-1c6ea561-8766-4403-aa9f-59d1a22004a4 req-5af82641-b5d3-412c-85db-329b57b99a1a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received unexpected event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 for instance with vm_state active and task_state None.
Aug 16 12:13:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-bf840676-8d0d-45b5-9715-47ebaf057798 req-95231e9c-5fbe-4496-beaa-2b4732c60067 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Received event network-vif-plugged-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bf840676-8d0d-45b5-9715-47ebaf057798 req-95231e9c-5fbe-4496-beaa-2b4732c60067 service nova] Acquiring lock "4ace588c-2910-477d-a2f1-259bea336e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bf840676-8d0d-45b5-9715-47ebaf057798 req-95231e9c-5fbe-4496-beaa-2b4732c60067 service nova] Lock "4ace588c-2910-477d-a2f1-259bea336e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bf840676-8d0d-45b5-9715-47ebaf057798 req-95231e9c-5fbe-4496-beaa-2b4732c60067 service nova] Lock "4ace588c-2910-477d-a2f1-259bea336e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-bf840676-8d0d-45b5-9715-47ebaf057798 req-95231e9c-5fbe-4496-beaa-2b4732c60067 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] No waiting events found dispatching network-vif-plugged-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:20 user nova-compute[73520]: WARNING nova.compute.manager [req-bf840676-8d0d-45b5-9715-47ebaf057798 req-95231e9c-5fbe-4496-beaa-2b4732c60067 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Received unexpected event network-vif-plugged-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 for instance with vm_state building and task_state spawning.
Aug 16 12:13:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] There are 0 instances to clean {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:13:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188001.8459818, 4ce719c9-0210-414f-bbf3-37bfa392125c => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:13:21 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] VM Resumed (Lifecycle Event)
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:13:21 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Instance spawned successfully.
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:21 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188001.8480737, 4ce719c9-0210-414f-bbf3-37bfa392125c => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:13:21 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] VM Started (Lifecycle Event)
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:13:21 user nova-compute[73520]: INFO nova.compute.manager [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Took 10.65 seconds to spawn the instance on the hypervisor.
Aug 16 12:13:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.manager [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Took 12.37 seconds to build instance.
Aug 16 12:13:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cd12b618-d9bb-45b3-9de0-aad41b177d19 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.536s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188002.2476172, 4ace588c-2910-477d-a2f1-259bea336e38 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] VM Resumed (Lifecycle Event)
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-84b3c7db-3827-44ff-8c99-eca7e37387b1 req-28c6d94f-0798-49e5-8053-d29f03a56c36 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Received event network-vif-plugged-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-84b3c7db-3827-44ff-8c99-eca7e37387b1 req-28c6d94f-0798-49e5-8053-d29f03a56c36 service nova] Acquiring lock "4ace588c-2910-477d-a2f1-259bea336e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-84b3c7db-3827-44ff-8c99-eca7e37387b1 req-28c6d94f-0798-49e5-8053-d29f03a56c36 service nova] Lock "4ace588c-2910-477d-a2f1-259bea336e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-84b3c7db-3827-44ff-8c99-eca7e37387b1 req-28c6d94f-0798-49e5-8053-d29f03a56c36 service nova] Lock "4ace588c-2910-477d-a2f1-259bea336e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-84b3c7db-3827-44ff-8c99-eca7e37387b1 req-28c6d94f-0798-49e5-8053-d29f03a56c36 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] No waiting events found dispatching network-vif-plugged-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:22 user nova-compute[73520]: WARNING nova.compute.manager [req-84b3c7db-3827-44ff-8c99-eca7e37387b1 req-28c6d94f-0798-49e5-8053-d29f03a56c36 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Received unexpected event network-vif-plugged-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 for instance with vm_state building and task_state spawning.
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Instance spawned successfully.
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188002.2496593, 4ace588c-2910-477d-a2f1-259bea336e38 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] VM Started (Lifecycle Event)
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.manager [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Took 14.36 seconds to spawn the instance on the hypervisor.
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.manager [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Took 15.47 seconds to build instance.
Aug 16 12:13:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7698cf99-0753-4c0e-b472-7fbd0162e80f tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "4ace588c-2910-477d-a2f1-259bea336e38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.596s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188002.6635604, c1492de2-3545-4ef7-bf3d-07e779d73f8d => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] VM Resumed (Lifecycle Event)
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Acquiring lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Instance spawned successfully.
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188002.668352, c1492de2-3545-4ef7-bf3d-07e779d73f8d => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] VM Started (Lifecycle Event)
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-7b322b4c-dd6a-49ef-b722-252cf0e627de req-edd2705e-bda1-4d1f-b542-1e3009f8301b service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Received event network-vif-plugged-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7b322b4c-dd6a-49ef-b722-252cf0e627de req-edd2705e-bda1-4d1f-b542-1e3009f8301b service nova] Acquiring lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7b322b4c-dd6a-49ef-b722-252cf0e627de req-edd2705e-bda1-4d1f-b542-1e3009f8301b service nova] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7b322b4c-dd6a-49ef-b722-252cf0e627de req-edd2705e-bda1-4d1f-b542-1e3009f8301b service nova] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-7b322b4c-dd6a-49ef-b722-252cf0e627de req-edd2705e-bda1-4d1f-b542-1e3009f8301b service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] No waiting events found dispatching network-vif-plugged-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:22 user nova-compute[73520]: WARNING nova.compute.manager [req-7b322b4c-dd6a-49ef-b722-252cf0e627de req-edd2705e-bda1-4d1f-b542-1e3009f8301b service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Received unexpected event network-vif-plugged-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 for instance with vm_state active and task_state None.
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.manager [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Took 10.65 seconds to spawn the instance on the hypervisor.
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:13:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:22 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:13:22 user nova-compute[73520]: INFO nova.compute.claims [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Claim successful on node user
Aug 16 12:13:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:23 user nova-compute[73520]: INFO nova.compute.manager [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Took 13.08 seconds to build instance.
Aug 16 12:13:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-af0077a2-bb83-40e4-b69a-cc3374b1fac7 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.267s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:13:23 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:13:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG nova.policy [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '168c3c187ad945d189d02b6673421f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcef9eab49a2463c945c9cb72ff61399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:13:23 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Creating image(s)
Aug 16 12:13:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "/opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "/opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:13:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.274s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.223s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk 1073741824" returned: 0 in 0.110s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.290s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Cannot resize image /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG nova.objects.instance [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lazy-loading 'migration_context' on Instance uuid 1c83f328-2bad-4efa-98f1-2568dcf6a0c3 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Received event network-vif-plugged-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] Acquiring lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] No waiting events found dispatching network-vif-plugged-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:24 user nova-compute[73520]: WARNING nova.compute.manager [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Received unexpected event network-vif-plugged-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 for instance with vm_state active and task_state None.
Aug 16 12:13:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Received event network-vif-plugged-4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] Acquiring lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] No waiting events found dispatching network-vif-plugged-4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:24 user nova-compute[73520]: WARNING nova.compute.manager [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Received unexpected event network-vif-plugged-4512d351-5628-4309-990f-dff795735e3c for instance with vm_state active and task_state None.
Aug 16 12:13:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Received event network-vif-plugged-4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] Acquiring lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] No waiting events found dispatching network-vif-plugged-4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:24 user nova-compute[73520]: WARNING nova.compute.manager [req-70d41692-5fa6-4f2a-b6ca-df7670b7249c req-7b2f1f3f-6fea-4f6b-a44f-b74cd9795f36 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Received unexpected event network-vif-plugged-4512d351-5628-4309-990f-dff795735e3c for instance with vm_state active and task_state None.
Aug 16 12:13:24 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Ensure instance console log exists: /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:13:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Successfully created port: 8eccd7a5-fc0e-4248-b18b-576f6433e2ff {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG nova.compute.manager [req-c3fb0e5c-fe9f-4347-9ec1-2999934f8a3a req-1be3e856-f9b0-467a-bb47-65f08ae0d57d service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Received event network-vif-plugged-8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c3fb0e5c-fe9f-4347-9ec1-2999934f8a3a req-1be3e856-f9b0-467a-bb47-65f08ae0d57d service nova] Acquiring lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c3fb0e5c-fe9f-4347-9ec1-2999934f8a3a req-1be3e856-f9b0-467a-bb47-65f08ae0d57d service nova] Lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c3fb0e5c-fe9f-4347-9ec1-2999934f8a3a req-1be3e856-f9b0-467a-bb47-65f08ae0d57d service nova] Lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG nova.compute.manager [req-c3fb0e5c-fe9f-4347-9ec1-2999934f8a3a req-1be3e856-f9b0-467a-bb47-65f08ae0d57d service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] No waiting events found dispatching network-vif-plugged-8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:25 user nova-compute[73520]: WARNING nova.compute.manager [req-c3fb0e5c-fe9f-4347-9ec1-2999934f8a3a req-1be3e856-f9b0-467a-bb47-65f08ae0d57d service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Received unexpected event network-vif-plugged-8752a2b2-4922-4822-ad90-f0a98e749b9f for instance with vm_state active and task_state None.
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Successfully updated port: 8eccd7a5-fc0e-4248-b18b-576f6433e2ff {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:13:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Acquiring lock "refresh_cache-1c83f328-2bad-4efa-98f1-2568dcf6a0c3" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:13:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Acquired lock "refresh_cache-1c83f328-2bad-4efa-98f1-2568dcf6a0c3" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:13:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:13:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Received event network-vif-plugged-8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] Acquiring lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] Lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] Lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] No waiting events found dispatching network-vif-plugged-8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:27 user nova-compute[73520]: WARNING nova.compute.manager [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Received unexpected event network-vif-plugged-8752a2b2-4922-4822-ad90-f0a98e749b9f for instance with vm_state active and task_state None.
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received event network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] No waiting events found dispatching network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:27 user nova-compute[73520]: WARNING nova.compute.manager [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received unexpected event network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c for instance with vm_state active and task_state None.
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Received event network-changed-8eccd7a5-fc0e-4248-b18b-576f6433e2ff {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Refreshing instance network info cache due to event network-changed-8eccd7a5-fc0e-4248-b18b-576f6433e2ff. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] Acquiring lock "refresh_cache-1c83f328-2bad-4efa-98f1-2568dcf6a0c3" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Updating instance_info_cache with network_info: [{"id": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "address": "fa:16:3e:e1:b5:4a", "network": {"id": "e08ad002-b4ec-4b1f-a853-17fca3a8321f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-122744988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcef9eab49a2463c945c9cb72ff61399", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eccd7a5-fc", "ovs_interfaceid": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Releasing lock "refresh_cache-1c83f328-2bad-4efa-98f1-2568dcf6a0c3" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Instance network_info: |[{"id": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "address": "fa:16:3e:e1:b5:4a", "network": {"id": "e08ad002-b4ec-4b1f-a853-17fca3a8321f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-122744988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcef9eab49a2463c945c9cb72ff61399", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eccd7a5-fc", "ovs_interfaceid": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] Acquired lock "refresh_cache-1c83f328-2bad-4efa-98f1-2568dcf6a0c3" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.network.neutron [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Refreshing network info cache for port 8eccd7a5-fc0e-4248-b18b-576f6433e2ff {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Start _get_guest_xml network_info=[{"id": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "address": "fa:16:3e:e1:b5:4a", "network": {"id": "e08ad002-b4ec-4b1f-a853-17fca3a8321f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-122744988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcef9eab49a2463c945c9cb72ff61399", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eccd7a5-fc", "ovs_interfaceid": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:13:27 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:27 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:13:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1697652939',display_name='tempest-VolumesActionsTest-instance-1697652939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1697652939',id=9,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcef9eab49a2463c945c9cb72ff61399',ramdisk_id='',reservation_id='r-j0f6cmy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1618629274',owner_user_name='tempest-VolumesActionsTest-1618629274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:24Z,user_data=None,user_id='168c3c187ad945d189d02b6673421f28',uuid=1c83f328-2bad-4efa-98f1-2568dcf6a0c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "address": "fa:16:3e:e1:b5:4a", "network": {"id": "e08ad002-b4ec-4b1f-a853-17fca3a8321f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-122744988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcef9eab49a2463c945c9cb72ff61399", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eccd7a5-fc", "ovs_interfaceid": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Converting VIF {"id": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "address": "fa:16:3e:e1:b5:4a", "network": {"id": "e08ad002-b4ec-4b1f-a853-17fca3a8321f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-122744988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcef9eab49a2463c945c9cb72ff61399", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eccd7a5-fc", "ovs_interfaceid": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=8eccd7a5-fc0e-4248-b18b-576f6433e2ff,network=Network(e08ad002-b4ec-4b1f-a853-17fca3a8321f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eccd7a5-fc') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.objects.instance [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c83f328-2bad-4efa-98f1-2568dcf6a0c3 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:13:27 user nova-compute[73520]:   <uuid>1c83f328-2bad-4efa-98f1-2568dcf6a0c3</uuid>
Aug 16 12:13:27 user nova-compute[73520]:   <name>instance-00000009</name>
Aug 16 12:13:27 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:13:27 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:13:27 user nova-compute[73520]:   <metadata>
Aug 16 12:13:27 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:13:27 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:13:27 user nova-compute[73520]:       <nova:name>tempest-VolumesActionsTest-instance-1697652939</nova:name>
Aug 16 12:13:27 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:13:27</nova:creationTime>
Aug 16 12:13:27 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:13:27 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:13:27 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:13:27 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:13:27 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:13:27 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:13:27 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:13:27 user nova-compute[73520]:       <nova:owner>
Aug 16 12:13:27 user nova-compute[73520]:         <nova:user uuid="168c3c187ad945d189d02b6673421f28">tempest-VolumesActionsTest-1618629274-project-member</nova:user>
Aug 16 12:13:27 user nova-compute[73520]:         <nova:project uuid="fcef9eab49a2463c945c9cb72ff61399">tempest-VolumesActionsTest-1618629274</nova:project>
Aug 16 12:13:27 user nova-compute[73520]:       </nova:owner>
Aug 16 12:13:27 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:13:27 user nova-compute[73520]:       <nova:ports>
Aug 16 12:13:27 user nova-compute[73520]:         <nova:port uuid="8eccd7a5-fc0e-4248-b18b-576f6433e2ff">
Aug 16 12:13:27 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 12:13:27 user nova-compute[73520]:         </nova:port>
Aug 16 12:13:27 user nova-compute[73520]:       </nova:ports>
Aug 16 12:13:27 user nova-compute[73520]:     </nova:instance>
Aug 16 12:13:27 user nova-compute[73520]:   </metadata>
Aug 16 12:13:27 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:13:27 user nova-compute[73520]:     <system>
Aug 16 12:13:27 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:13:27 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:13:27 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:13:27 user nova-compute[73520]:       <entry name="serial">1c83f328-2bad-4efa-98f1-2568dcf6a0c3</entry>
Aug 16 12:13:27 user nova-compute[73520]:       <entry name="uuid">1c83f328-2bad-4efa-98f1-2568dcf6a0c3</entry>
Aug 16 12:13:27 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:13:27 user nova-compute[73520]:     </system>
Aug 16 12:13:27 user nova-compute[73520]:   </sysinfo>
Aug 16 12:13:27 user nova-compute[73520]:   <os>
Aug 16 12:13:27 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:13:27 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:13:27 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:13:27 user nova-compute[73520]:   </os>
Aug 16 12:13:27 user nova-compute[73520]:   <features>
Aug 16 12:13:27 user nova-compute[73520]:     <acpi/>
Aug 16 12:13:27 user nova-compute[73520]:     <apic/>
Aug 16 12:13:27 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:13:27 user nova-compute[73520]:   </features>
Aug 16 12:13:27 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:13:27 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:13:27 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:13:27 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:13:27 user nova-compute[73520]:   </clock>
Aug 16 12:13:27 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:13:27 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:13:27 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:13:27 user nova-compute[73520]:   </cpu>
Aug 16 12:13:27 user nova-compute[73520]:   <devices>
Aug 16 12:13:27 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:13:27 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:13:27 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk"/>
Aug 16 12:13:27 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:13:27 user nova-compute[73520]:     </disk>
Aug 16 12:13:27 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:13:27 user nova-compute[73520]:       <mac address="fa:16:3e:e1:b5:4a"/>
Aug 16 12:13:27 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:13:27 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:13:27 user nova-compute[73520]:       <target dev="tap8eccd7a5-fc"/>
Aug 16 12:13:27 user nova-compute[73520]:     </interface>
Aug 16 12:13:27 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:13:27 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/console.log" append="off"/>
Aug 16 12:13:27 user nova-compute[73520]:     </serial>
Aug 16 12:13:27 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:13:27 user nova-compute[73520]:     <video>
Aug 16 12:13:27 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:13:27 user nova-compute[73520]:     </video>
Aug 16 12:13:27 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:13:27 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:13:27 user nova-compute[73520]:     </rng>
Aug 16 12:13:27 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:13:27 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:13:27 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:13:27 user nova-compute[73520]:     </memballoon>
Aug 16 12:13:27 user nova-compute[73520]:   </devices>
Aug 16 12:13:27 user nova-compute[73520]: </domain>
Aug 16 12:13:27 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:13:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1697652939',display_name='tempest-VolumesActionsTest-instance-1697652939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1697652939',id=9,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcef9eab49a2463c945c9cb72ff61399',ramdisk_id='',reservation_id='r-j0f6cmy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1618629274',owner_user_name='tempest-VolumesActionsTest-1618629274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:24Z,user_data=None,user_id='168c3c187ad945d189d02b6673421f28',uuid=1c83f328-2bad-4efa-98f1-2568dcf6a0c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "address": "fa:16:3e:e1:b5:4a", "network": {"id": "e08ad002-b4ec-4b1f-a853-17fca3a8321f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-122744988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcef9eab49a2463c945c9cb72ff61399", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eccd7a5-fc", "ovs_interfaceid": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Converting VIF {"id": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "address": "fa:16:3e:e1:b5:4a", "network": {"id": "e08ad002-b4ec-4b1f-a853-17fca3a8321f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-122744988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcef9eab49a2463c945c9cb72ff61399", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eccd7a5-fc", "ovs_interfaceid": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=8eccd7a5-fc0e-4248-b18b-576f6433e2ff,network=Network(e08ad002-b4ec-4b1f-a853-17fca3a8321f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eccd7a5-fc') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG os_vif [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=8eccd7a5-fc0e-4248-b18b-576f6433e2ff,network=Network(e08ad002-b4ec-4b1f-a853-17fca3a8321f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eccd7a5-fc') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eccd7a5-fc, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8eccd7a5-fc, col_values=(('external_ids', {'iface-id': '8eccd7a5-fc0e-4248-b18b-576f6433e2ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:b5:4a', 'vm-uuid': '1c83f328-2bad-4efa-98f1-2568dcf6a0c3'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:13:27 user nova-compute[73520]: INFO os_vif [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=8eccd7a5-fc0e-4248-b18b-576f6433e2ff,network=Network(e08ad002-b4ec-4b1f-a853-17fca3a8321f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eccd7a5-fc')
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] No VIF found with MAC fa:16:3e:e1:b5:4a, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.network.neutron [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Updated VIF entry in instance network info cache for port 8eccd7a5-fc0e-4248-b18b-576f6433e2ff. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.network.neutron [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Updating instance_info_cache with network_info: [{"id": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "address": "fa:16:3e:e1:b5:4a", "network": {"id": "e08ad002-b4ec-4b1f-a853-17fca3a8321f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-122744988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcef9eab49a2463c945c9cb72ff61399", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eccd7a5-fc", "ovs_interfaceid": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188011.9148445, 1c83f328-2bad-4efa-98f1-2568dcf6a0c3 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:13:32 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] VM Resumed (Lifecycle Event)
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.manager [req-bb44c022-d053-46b3-a766-aa049ee57432 req-eb974e47-d0e1-46ac-ad6a-3c982b8e87ea service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Received event network-vif-plugged-8eccd7a5-fc0e-4248-b18b-576f6433e2ff {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bb44c022-d053-46b3-a766-aa049ee57432 req-eb974e47-d0e1-46ac-ad6a-3c982b8e87ea service nova] Acquiring lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bb44c022-d053-46b3-a766-aa049ee57432 req-eb974e47-d0e1-46ac-ad6a-3c982b8e87ea service nova] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bb44c022-d053-46b3-a766-aa049ee57432 req-eb974e47-d0e1-46ac-ad6a-3c982b8e87ea service nova] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.manager [req-bb44c022-d053-46b3-a766-aa049ee57432 req-eb974e47-d0e1-46ac-ad6a-3c982b8e87ea service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] No waiting events found dispatching network-vif-plugged-8eccd7a5-fc0e-4248-b18b-576f6433e2ff {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:32 user nova-compute[73520]: WARNING nova.compute.manager [req-bb44c022-d053-46b3-a766-aa049ee57432 req-eb974e47-d0e1-46ac-ad6a-3c982b8e87ea service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Received unexpected event network-vif-plugged-8eccd7a5-fc0e-4248-b18b-576f6433e2ff for instance with vm_state building and task_state spawning.
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.manager [req-f4d4ab8f-39b6-4fe3-b2e6-f1141e5d1552 req-514892a0-ebf2-431d-9844-05da1910bf1c service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Received event network-vif-plugged-8eccd7a5-fc0e-4248-b18b-576f6433e2ff {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f4d4ab8f-39b6-4fe3-b2e6-f1141e5d1552 req-514892a0-ebf2-431d-9844-05da1910bf1c service nova] Acquiring lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f4d4ab8f-39b6-4fe3-b2e6-f1141e5d1552 req-514892a0-ebf2-431d-9844-05da1910bf1c service nova] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f4d4ab8f-39b6-4fe3-b2e6-f1141e5d1552 req-514892a0-ebf2-431d-9844-05da1910bf1c service nova] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.manager [req-f4d4ab8f-39b6-4fe3-b2e6-f1141e5d1552 req-514892a0-ebf2-431d-9844-05da1910bf1c service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] No waiting events found dispatching network-vif-plugged-8eccd7a5-fc0e-4248-b18b-576f6433e2ff {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:32 user nova-compute[73520]: WARNING nova.compute.manager [req-f4d4ab8f-39b6-4fe3-b2e6-f1141e5d1552 req-514892a0-ebf2-431d-9844-05da1910bf1c service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Received unexpected event network-vif-plugged-8eccd7a5-fc0e-4248-b18b-576f6433e2ff for instance with vm_state building and task_state spawning.
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] Releasing lock "refresh_cache-1c83f328-2bad-4efa-98f1-2568dcf6a0c3" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.manager [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received event network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.manager [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] No waiting events found dispatching network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:32 user nova-compute[73520]: WARNING nova.compute.manager [req-3fbbe391-1e99-4b66-9e28-3f43fa0759fc req-74fc6efc-cadd-433b-a1a8-aaba15dc2598 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received unexpected event network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c for instance with vm_state active and task_state None.
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:32 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:32 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7695MB free_disk=25.83985137939453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:32 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Instance spawned successfully.
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:32 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188011.950496, 1c83f328-2bad-4efa-98f1-2568dcf6a0c3 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:13:32 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] VM Started (Lifecycle Event)
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:13:32 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:13:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:32 user nova-compute[73520]: INFO nova.compute.manager [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Took 8.88 seconds to spawn the instance on the hypervisor.
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:32 user nova-compute[73520]: INFO nova.compute.manager [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Took 9.96 seconds to build instance.
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a626c005-d531-429b-8da3-db2cca3e8a1c tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.148s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 9e339769-9db0-4fa3-b966-3cc1c2a24789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 636510f6-acfa-4705-bfb1-03df3f9297be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1e35c753-7af1-4047-ad06-8b5755207b8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4ace588c-2910-477d-a2f1-259bea336e38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4ce719c9-0210-414f-bbf3-37bfa392125c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance c1492de2-3545-4ef7-bf3d-07e779d73f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1c83f328-2bad-4efa-98f1-2568dcf6a0c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2462cd5c-8c3b-49e6-82a9-6539c57edb1e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:13:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:13:33 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing inventories for resource provider 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 12:13:33 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating ProviderTree inventory for provider 70dde5f5-9594-47c3-954e-598dd3089747 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 12:13:33 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 12:13:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:33 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing aggregate associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, aggregates: None {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 12:13:33 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing trait associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 12:13:33 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:13:33 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:13:33 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:13:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.261s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.809s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:13:33 user nova-compute[73520]: INFO nova.compute.claims [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Claim successful on node user
Aug 16 12:13:34 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:13:34 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:13:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:13:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:13:34 user nova-compute[73520]: DEBUG nova.network.neutron [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:13:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:13:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:13:34 user nova-compute[73520]: DEBUG nova.policy [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cabd18e57f6f4859a0e86ab2e4360721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d27d28a99784c87ae3a67834abbcc38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:13:34 user nova-compute[73520]: INFO nova.virt.block_device [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Booting with volume f1a466b2-9d08-4a37-9932-1b71914de525 at /dev/vda
Aug 16 12:13:34 user nova-compute[73520]: DEBUG os_brick.utils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:13:34 user nova-compute[73520]: INFO oslo.privsep.daemon [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpm8_ebfir/privsep.sock']
Aug 16 12:13:34 user sudo[84369]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpm8_ebfir/privsep.sock
Aug 16 12:13:34 user sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 12:13:35 user nova-compute[73520]: DEBUG nova.network.neutron [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Successfully created port: dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:13:35 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:13:35 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:13:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:13:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:13:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Skipping network cache update for instance because it is Building. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 12:13:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-9e339769-9db0-4fa3-b966-3cc1c2a24789" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:13:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-9e339769-9db0-4fa3-b966-3cc1c2a24789" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:13:35 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:13:35 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 9e339769-9db0-4fa3-b966-3cc1c2a24789 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG nova.network.neutron [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Successfully updated port: dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Updating instance_info_cache with network_info: [{"id": "b98fbde0-e7c2-4038-b436-57567ad76754", "address": "fa:16:3e:9f:95:73", "network": {"id": "c508e024-e875-4ffb-9945-d6ef43b597d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-953780218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a6719264f84d308785e48fbca9ee31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98fbde0-e7", "ovs_interfaceid": "b98fbde0-e7c2-4038-b436-57567ad76754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "refresh_cache-2462cd5c-8c3b-49e6-82a9-6539c57edb1e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquired lock "refresh_cache-2462cd5c-8c3b-49e6-82a9-6539c57edb1e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG nova.network.neutron [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-9e339769-9db0-4fa3-b966-3cc1c2a24789" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-89985b3d-ebec-4ef9-9a12-4050c2ad5a28 req-2f6084a5-d00b-45f6-b75f-ddbd2b6fe338 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received event network-changed-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-89985b3d-ebec-4ef9-9a12-4050c2ad5a28 req-2f6084a5-d00b-45f6-b75f-ddbd2b6fe338 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Refreshing instance network info cache due to event network-changed-dbb56176-1321-4be7-b72f-4c2bb0d9f9af. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-89985b3d-ebec-4ef9-9a12-4050c2ad5a28 req-2f6084a5-d00b-45f6-b75f-ddbd2b6fe338 service nova] Acquiring lock "refresh_cache-2462cd5c-8c3b-49e6-82a9-6539c57edb1e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:13:36 user nova-compute[73520]: DEBUG nova.network.neutron [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:13:36 user sudo[84369]: pam_unix(sudo:session): session closed for user root
Aug 16 12:13:36 user nova-compute[73520]: INFO oslo.privsep.daemon [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Spawned new privsep daemon via rootwrap
Aug 16 12:13:36 user nova-compute[73520]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 12:13:36 user nova-compute[73520]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 12:13:36 user nova-compute[73520]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 16 12:13:36 user nova-compute[73520]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84372
Aug 16 12:13:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[43360c6b-7d3b-4e83-a6fc-b70e71c826be]: (2,) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81fe3ed-2f50-42bd-b8ec-d4f574f34bef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:37 user nova-compute[73520]: WARNING os_brick.initiator.connectors.nvmeof [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53125f1-6fb8-4313-9243-4a124c23c4b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[db83e3fe-7772-42f7-9101-3499ca2c3f48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe76038-4195-4857-9686-711995a45862]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG nova.network.neutron [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Updating instance_info_cache with network_info: [{"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Releasing lock "refresh_cache-2462cd5c-8c3b-49e6-82a9-6539c57edb1e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Instance network_info: |[{"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-89985b3d-ebec-4ef9-9a12-4050c2ad5a28 req-2f6084a5-d00b-45f6-b75f-ddbd2b6fe338 service nova] Acquired lock "refresh_cache-2462cd5c-8c3b-49e6-82a9-6539c57edb1e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG nova.network.neutron [req-89985b3d-ebec-4ef9-9a12-4050c2ad5a28 req-2f6084a5-d00b-45f6-b75f-ddbd2b6fe338 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Refreshing network info cache for port dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:13:37 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dba9d0-2a39-4da5-b5c1-18eb59be9767]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG os_brick.utils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] <== get_connector_properties: return (2558ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Updating existing volume attachment record: fa0cc193-cd37-4da6-b30e-ca8ac0cc836c {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG nova.network.neutron [req-89985b3d-ebec-4ef9-9a12-4050c2ad5a28 req-2f6084a5-d00b-45f6-b75f-ddbd2b6fe338 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Updated VIF entry in instance network info cache for port dbb56176-1321-4be7-b72f-4c2bb0d9f9af. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG nova.network.neutron [req-89985b3d-ebec-4ef9-9a12-4050c2ad5a28 req-2f6084a5-d00b-45f6-b75f-ddbd2b6fe338 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Updating instance_info_cache with network_info: [{"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:13:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-89985b3d-ebec-4ef9-9a12-4050c2ad5a28 req-2f6084a5-d00b-45f6-b75f-ddbd2b6fe338 service nova] Releasing lock "refresh_cache-2462cd5c-8c3b-49e6-82a9-6539c57edb1e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:13:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:13:47 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Creating image(s)
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Ensure instance console log exists: /opt/stack/data/nova/instances/2462cd5c-8c3b-49e6-82a9-6539c57edb1e/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Start _get_guest_xml network_info=[{"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfvZMXCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2462cd5c-8c3b-49e6-82a9-6539c57edb1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1a466b2-9d08-4a37-9932-1b71914de525', 'serial': 'f1a466b2-9d08-4a37-9932-1b71914de525'}, 'attachment_id': 'fa0cc193-cd37-4da6-b30e-ca8ac0cc836c', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:13:47 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:47 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG os_brick.initiator.connector [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Factory for ISCSI on None {{(pid=73520) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfvZMXCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:13:47 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:13:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:13:47 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:13:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:13:47 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:13:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[70262cf1-9faf-45a2-a453-f0c20bc110d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:13:47 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b9a5f2-ed71-4653-80d6-bf4884c12e3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525] added
Aug 16 12:13:47 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:13:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0d2194-b5b3-4e13-ae4a-acac2f64f186]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7047eedb-4eb2-467c-a346-aa34a1ae44a4]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfvZMXCI {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfvZMXCI" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa749ba-1735-4dd1-b844-03df31f7f8c5]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zfvZMXCI'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[21faad9f-2183-4d46-a38d-8e18f41b9d44]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84a5437-a62b-4f2e-b412-51e277c48637]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:13:48 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:13:48 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:13:48 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 12:13:48 user nova-compute[73520]: 
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2964ede8-bcf5-43a0-911a-446dcb74f79b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260]
Aug 16 12:13:48 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260] successful.
Aug 16 12:13:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3784ff-c50a-4617-9a53-ce66d1bcb171]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2a9ed4-ed95-4362-ba40-b749e6af2648]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:13:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:13:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[900310a7-dec0-4708-aa3d-b2b09fc89150]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfvZMXCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26331306536633834', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331306536633834', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:13:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1649896200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1649896200',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5lfnNQjk309WHNPoJplqkTWZJCEIgsyDnf1ntfB3MA1o2pn1nFQq7KWgW/Px4t5P3JE58yASksLFE80axLqKjOyguTxIgo/Xo+NW6ip7AMowz4RnKZLCPN8GpS0T7CgA==',key_name='tempest-keypair-280741756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d27d28a99784c87ae3a67834abbcc38',ramdisk_id='',reservation_id='r-2ozrmaur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-847817773',owner_user_name='tempest-ServerActionsV293TestJSON-847817773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cabd18e57f6f4859a0e86ab2e4360721',uuid=2462cd5c-8c3b-49e6-82a9-6539c57edb1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Converting VIF {"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG nova.objects.instance [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lazy-loading 'pci_devices' on Instance uuid 2462cd5c-8c3b-49e6-82a9-6539c57edb1e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:13:49 user nova-compute[73520]:   <uuid>2462cd5c-8c3b-49e6-82a9-6539c57edb1e</uuid>
Aug 16 12:13:49 user nova-compute[73520]:   <name>instance-0000000a</name>
Aug 16 12:13:49 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:13:49 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:13:49 user nova-compute[73520]:   <metadata>
Aug 16 12:13:49 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:13:49 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:13:49 user nova-compute[73520]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1649896200</nova:name>
Aug 16 12:13:49 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:13:47</nova:creationTime>
Aug 16 12:13:49 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:13:49 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:13:49 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:13:49 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:13:49 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:13:49 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:13:49 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:13:49 user nova-compute[73520]:       <nova:owner>
Aug 16 12:13:49 user nova-compute[73520]:         <nova:user uuid="cabd18e57f6f4859a0e86ab2e4360721">tempest-ServerActionsV293TestJSON-847817773-project-member</nova:user>
Aug 16 12:13:49 user nova-compute[73520]:         <nova:project uuid="9d27d28a99784c87ae3a67834abbcc38">tempest-ServerActionsV293TestJSON-847817773</nova:project>
Aug 16 12:13:49 user nova-compute[73520]:       </nova:owner>
Aug 16 12:13:49 user nova-compute[73520]:       <nova:ports>
Aug 16 12:13:49 user nova-compute[73520]:         <nova:port uuid="dbb56176-1321-4be7-b72f-4c2bb0d9f9af">
Aug 16 12:13:49 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 12:13:49 user nova-compute[73520]:         </nova:port>
Aug 16 12:13:49 user nova-compute[73520]:       </nova:ports>
Aug 16 12:13:49 user nova-compute[73520]:     </nova:instance>
Aug 16 12:13:49 user nova-compute[73520]:   </metadata>
Aug 16 12:13:49 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:13:49 user nova-compute[73520]:     <system>
Aug 16 12:13:49 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:13:49 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:13:49 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:13:49 user nova-compute[73520]:       <entry name="serial">2462cd5c-8c3b-49e6-82a9-6539c57edb1e</entry>
Aug 16 12:13:49 user nova-compute[73520]:       <entry name="uuid">2462cd5c-8c3b-49e6-82a9-6539c57edb1e</entry>
Aug 16 12:13:49 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:13:49 user nova-compute[73520]:     </system>
Aug 16 12:13:49 user nova-compute[73520]:   </sysinfo>
Aug 16 12:13:49 user nova-compute[73520]:   <os>
Aug 16 12:13:49 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:13:49 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:13:49 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:13:49 user nova-compute[73520]:   </os>
Aug 16 12:13:49 user nova-compute[73520]:   <features>
Aug 16 12:13:49 user nova-compute[73520]:     <acpi/>
Aug 16 12:13:49 user nova-compute[73520]:     <apic/>
Aug 16 12:13:49 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:13:49 user nova-compute[73520]:   </features>
Aug 16 12:13:49 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:13:49 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:13:49 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:13:49 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:13:49 user nova-compute[73520]:   </clock>
Aug 16 12:13:49 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:13:49 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:13:49 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:13:49 user nova-compute[73520]:   </cpu>
Aug 16 12:13:49 user nova-compute[73520]:   <devices>
Aug 16 12:13:49 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:13:49 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:13:49 user nova-compute[73520]:       <source dev="/dev/sdb"/>
Aug 16 12:13:49 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:13:49 user nova-compute[73520]:       <serial>f1a466b2-9d08-4a37-9932-1b71914de525</serial>
Aug 16 12:13:49 user nova-compute[73520]:     </disk>
Aug 16 12:13:49 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:13:49 user nova-compute[73520]:       <mac address="fa:16:3e:ec:38:f9"/>
Aug 16 12:13:49 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:13:49 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:13:49 user nova-compute[73520]:       <target dev="tapdbb56176-13"/>
Aug 16 12:13:49 user nova-compute[73520]:     </interface>
Aug 16 12:13:49 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:13:49 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/2462cd5c-8c3b-49e6-82a9-6539c57edb1e/console.log" append="off"/>
Aug 16 12:13:49 user nova-compute[73520]:     </serial>
Aug 16 12:13:49 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:13:49 user nova-compute[73520]:     <video>
Aug 16 12:13:49 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:13:49 user nova-compute[73520]:     </video>
Aug 16 12:13:49 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:13:49 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:13:49 user nova-compute[73520]:     </rng>
Aug 16 12:13:49 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:13:49 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:13:49 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:13:49 user nova-compute[73520]:     </memballoon>
Aug 16 12:13:49 user nova-compute[73520]:   </devices>
Aug 16 12:13:49 user nova-compute[73520]: </domain>
Aug 16 12:13:49 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:13:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1649896200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1649896200',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5lfnNQjk309WHNPoJplqkTWZJCEIgsyDnf1ntfB3MA1o2pn1nFQq7KWgW/Px4t5P3JE58yASksLFE80axLqKjOyguTxIgo/Xo+NW6ip7AMowz4RnKZLCPN8GpS0T7CgA==',key_name='tempest-keypair-280741756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d27d28a99784c87ae3a67834abbcc38',ramdisk_id='',reservation_id='r-2ozrmaur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-847817773',owner_user_name='tempest-ServerActionsV293TestJSON-847817773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cabd18e57f6f4859a0e86ab2e4360721',uuid=2462cd5c-8c3b-49e6-82a9-6539c57edb1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Converting VIF {"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG os_vif [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbb56176-13, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbb56176-13, col_values=(('external_ids', {'iface-id': 'dbb56176-1321-4be7-b72f-4c2bb0d9f9af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:38:f9', 'vm-uuid': '2462cd5c-8c3b-49e6-82a9-6539c57edb1e'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:49 user nova-compute[73520]: INFO os_vif [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13')
Aug 16 12:13:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:13:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] No VIF found with MAC fa:16:3e:ec:38:f9, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:13:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-d754abba-e7e3-4072-be0e-5c016a44b499 req-6c5ab6e7-09ba-49c5-aefa-dfda7392f08a service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received event network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d754abba-e7e3-4072-be0e-5c016a44b499 req-6c5ab6e7-09ba-49c5-aefa-dfda7392f08a service nova] Acquiring lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d754abba-e7e3-4072-be0e-5c016a44b499 req-6c5ab6e7-09ba-49c5-aefa-dfda7392f08a service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d754abba-e7e3-4072-be0e-5c016a44b499 req-6c5ab6e7-09ba-49c5-aefa-dfda7392f08a service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-d754abba-e7e3-4072-be0e-5c016a44b499 req-6c5ab6e7-09ba-49c5-aefa-dfda7392f08a service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] No waiting events found dispatching network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:50 user nova-compute[73520]: WARNING nova.compute.manager [req-d754abba-e7e3-4072-be0e-5c016a44b499 req-6c5ab6e7-09ba-49c5-aefa-dfda7392f08a service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received unexpected event network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af for instance with vm_state building and task_state spawning.
Aug 16 12:13:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188032.7447243, 2462cd5c-8c3b-49e6-82a9-6539c57edb1e => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:13:52 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] VM Resumed (Lifecycle Event)
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:13:52 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Instance spawned successfully.
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:13:52 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188032.7504585, 2462cd5c-8c3b-49e6-82a9-6539c57edb1e => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:13:52 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] VM Started (Lifecycle Event)
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:13:52 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:13:52 user nova-compute[73520]: INFO nova.compute.manager [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.compute.manager [req-03695087-cd12-42ce-906c-8521049f77cf req-3446e85f-5179-46bf-a47f-1f888776d7cf service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received event network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-03695087-cd12-42ce-906c-8521049f77cf req-3446e85f-5179-46bf-a47f-1f888776d7cf service nova] Acquiring lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-03695087-cd12-42ce-906c-8521049f77cf req-3446e85f-5179-46bf-a47f-1f888776d7cf service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-03695087-cd12-42ce-906c-8521049f77cf req-3446e85f-5179-46bf-a47f-1f888776d7cf service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:52 user nova-compute[73520]: DEBUG nova.compute.manager [req-03695087-cd12-42ce-906c-8521049f77cf req-3446e85f-5179-46bf-a47f-1f888776d7cf service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] No waiting events found dispatching network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:13:52 user nova-compute[73520]: WARNING nova.compute.manager [req-03695087-cd12-42ce-906c-8521049f77cf req-3446e85f-5179-46bf-a47f-1f888776d7cf service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received unexpected event network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af for instance with vm_state building and task_state spawning.
Aug 16 12:13:53 user nova-compute[73520]: INFO nova.compute.manager [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Took 20.36 seconds to build instance.
Aug 16 12:13:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-422afbcd-8fb6-496b-9958-56759bc9264f tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.602s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG nova.compute.manager [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:13:57 user nova-compute[73520]: INFO nova.compute.claims [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Claim successful on node user
Aug 16 12:13:57 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG nova.compute.manager [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG nova.compute.manager [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:13:57 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:13:57 user nova-compute[73520]: DEBUG nova.compute.manager [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:13:57 user nova-compute[73520]: INFO nova.virt.block_device [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Booting with volume d21b2a79-9685-465d-8aa3-a36c978d53dc at /dev/vda
Aug 16 12:13:57 user nova-compute[73520]: DEBUG nova.policy [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2f6368a69254d3fa9b4d8e9f725569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e591da95a84cb0b3c2e42ff63b13ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG os_brick.utils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fab599-f8b0-47cf-bf01-aeb084adc984]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a01ea99-c28b-4769-88a1-b521e0e76d56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8db418-d514-4a50-b345-af2c57b577c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[197b39cd-8e04-4dae-bc9d-62b210cf3862]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:13:58 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:13:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a757c1c-6b28-4588-9dd1-5e3bed7752cc]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG os_brick.utils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating existing volume attachment record: 55846f8e-6e6c-469c-9a70-1e504ab35686 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:13:58 user nova-compute[73520]: INFO nova.compute.claims [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Claim successful on node user
Aug 16 12:13:58 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Successfully created port: a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:13:58 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:13:58 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:13:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:13:59 user nova-compute[73520]: INFO nova.virt.block_device [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Booting with volume d0318da1-09d3-4916-a9fb-8168456b93ad at /dev/vda
Aug 16 12:13:59 user nova-compute[73520]: DEBUG os_brick.utils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2a64ac-e61b-44f7-b23e-10db7af8fd6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[19567e7f-bd3c-4bf8-afd6-1bcc2a740503]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccfa7e1-3ac4-4df2-86f1-c165b32d44e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c04fe1d-d016-4e45-a3ac-ab4671fb35bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:13:59 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:13:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[da664308-b891-4186-adfb-a24f9d3aacdd]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG os_brick.utils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating existing volume attachment record: 4d93f4a5-b40d-4176-88fe-562163887123 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG nova.policy [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb48cfae9bca41bbac0fff658bf6cdbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644147b7898849d188d90d8faf1224c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:13:59 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Successfully created port: 48df8bb9-8a61-49bd-b0b0-7a4b56b87660 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:14:00 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Successfully created port: ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:14:00 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Successfully created port: d2010228-e41b-4fe6-b814-cfb931b5107a {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:14:01 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Successfully created port: e289552d-05b7-418b-97c2-7d13c956b3fa {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:14:02 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Successfully created port: ee409ffe-08fa-490f-ab00-0c107a83ad39 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:14:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:03 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Successfully created port: 2c8f553a-1fb2-4a3b-80dd-0d549112f793 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:14:03 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Successfully created port: d2be9b32-5339-4e58-abd1-02cf8c09b9e2 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:14:04 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Successfully created port: 43824ad0-ef35-4471-9ce5-ffedc9f3784a {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:14:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:04 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Successfully updated port: a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-e4cd2cfc-9404-465e-8549-8c7ba064c7e5 req-58672ba4-25fa-4473-8707-6ff0bc1b450a service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-changed-a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-e4cd2cfc-9404-465e-8549-8c7ba064c7e5 req-58672ba4-25fa-4473-8707-6ff0bc1b450a service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing instance network info cache due to event network-changed-a17b4d8a-28aa-450d-b11c-6254f52c9cbb. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e4cd2cfc-9404-465e-8549-8c7ba064c7e5 req-58672ba4-25fa-4473-8707-6ff0bc1b450a service nova] Acquiring lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e4cd2cfc-9404-465e-8549-8c7ba064c7e5 req-58672ba4-25fa-4473-8707-6ff0bc1b450a service nova] Acquired lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:04 user nova-compute[73520]: DEBUG nova.network.neutron [req-e4cd2cfc-9404-465e-8549-8c7ba064c7e5 req-58672ba4-25fa-4473-8707-6ff0bc1b450a service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing network info cache for port a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:04 user nova-compute[73520]: DEBUG nova.network.neutron [req-e4cd2cfc-9404-465e-8549-8c7ba064c7e5 req-58672ba4-25fa-4473-8707-6ff0bc1b450a service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:14:05 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Successfully created port: c60f87c0-2d15-4360-8fa0-bf406fff942d {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:14:05 user nova-compute[73520]: DEBUG nova.network.neutron [req-e4cd2cfc-9404-465e-8549-8c7ba064c7e5 req-58672ba4-25fa-4473-8707-6ff0bc1b450a service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e4cd2cfc-9404-465e-8549-8c7ba064c7e5 req-58672ba4-25fa-4473-8707-6ff0bc1b450a service nova] Releasing lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:06 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Successfully updated port: 16cf4ff6-8636-43c0-95c6-8cd845011d8f {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:06 user nova-compute[73520]: DEBUG nova.compute.manager [req-feaff9e8-90f5-4e19-8ed9-125b78968800 req-04d79fac-75f8-4dec-80ae-425d911a6f1e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-changed-16cf4ff6-8636-43c0-95c6-8cd845011d8f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:06 user nova-compute[73520]: DEBUG nova.compute.manager [req-feaff9e8-90f5-4e19-8ed9-125b78968800 req-04d79fac-75f8-4dec-80ae-425d911a6f1e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing instance network info cache due to event network-changed-16cf4ff6-8636-43c0-95c6-8cd845011d8f. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-feaff9e8-90f5-4e19-8ed9-125b78968800 req-04d79fac-75f8-4dec-80ae-425d911a6f1e service nova] Acquiring lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-feaff9e8-90f5-4e19-8ed9-125b78968800 req-04d79fac-75f8-4dec-80ae-425d911a6f1e service nova] Acquired lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:06 user nova-compute[73520]: DEBUG nova.network.neutron [req-feaff9e8-90f5-4e19-8ed9-125b78968800 req-04d79fac-75f8-4dec-80ae-425d911a6f1e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing network info cache for port 16cf4ff6-8636-43c0-95c6-8cd845011d8f {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:06 user nova-compute[73520]: DEBUG nova.network.neutron [req-feaff9e8-90f5-4e19-8ed9-125b78968800 req-04d79fac-75f8-4dec-80ae-425d911a6f1e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:14:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Successfully updated port: ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:07 user nova-compute[73520]: DEBUG nova.network.neutron [req-feaff9e8-90f5-4e19-8ed9-125b78968800 req-04d79fac-75f8-4dec-80ae-425d911a6f1e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-feaff9e8-90f5-4e19-8ed9-125b78968800 req-04d79fac-75f8-4dec-80ae-425d911a6f1e service nova] Releasing lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:08 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Successfully updated port: c775e42a-3c5e-456f-ba77-911c8dc4aa93 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:08 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Successfully updated port: 55dedb2f-d7f3-4f2e-bbff-90f53641c5ca {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-changed-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing instance network info cache due to event network-changed-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] Acquiring lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] Acquired lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:08 user nova-compute[73520]: DEBUG nova.network.neutron [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing network info cache for port ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] Releasing lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-changed-c775e42a-3c5e-456f-ba77-911c8dc4aa93 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing instance network info cache due to event network-changed-c775e42a-3c5e-456f-ba77-911c8dc4aa93. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] Acquiring lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] Acquired lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing network info cache for port c775e42a-3c5e-456f-ba77-911c8dc4aa93 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] Releasing lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-changed-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing instance network info cache due to event network-changed-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] Acquiring lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] Acquired lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing network info cache for port 55dedb2f-d7f3-4f2e-bbff-90f53641c5ca {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Successfully updated port: 48df8bb9-8a61-49bd-b0b0-7a4b56b87660 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c2112aab-39e5-4008-b8e9-782c677babca req-f9870322-f5ee-4bc1-8697-9492e32c5cf1 service nova] Releasing lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:09 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Successfully updated port: a983f522-a453-4636-a051-5780b31b3092 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-changed-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing instance network info cache due to event network-changed-48df8bb9-8a61-49bd-b0b0-7a4b56b87660. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] Acquiring lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] Acquired lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing network info cache for port 48df8bb9-8a61-49bd-b0b0-7a4b56b87660 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Successfully updated port: d2010228-e41b-4fe6-b814-cfb931b5107a {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] Releasing lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-changed-a983f522-a453-4636-a051-5780b31b3092 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing instance network info cache due to event network-changed-a983f522-a453-4636-a051-5780b31b3092. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] Acquiring lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] Acquired lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing network info cache for port a983f522-a453-4636-a051-5780b31b3092 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3471196d-982c-4bf4-9897-b63d8273cfff req-f56db882-b2dd-4bf7-a7a3-774e3c1508b5 service nova] Releasing lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:11 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Successfully updated port: e289552d-05b7-418b-97c2-7d13c956b3fa {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:12 user nova-compute[73520]: INFO nova.virt.block_device [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Booting with volume a12dc311-b21c-47af-84b7-1d5dc129e45a at /dev/vdb
Aug 16 12:14:12 user nova-compute[73520]: DEBUG os_brick.utils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e29b37-698a-4057-a9f1-16370da421c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc7eed1-f7bc-4b23-a2e8-b8f24e160678]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82b643e-288d-4ca1-ae80-113d8e84f192]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3398014f-5a83-4d1b-aa0c-288630629db4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:12 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:14:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee232e8-ebab-457b-9d95-92f1da9e3883]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG os_brick.utils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating existing volume attachment record: f02b860a-f0be-4522-99bf-2318e2615e0b {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:14:12 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Successfully updated port: ee409ffe-08fa-490f-ab00-0c107a83ad39 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Successfully updated port: 2c8f553a-1fb2-4a3b-80dd-0d549112f793 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-changed-d2010228-e41b-4fe6-b814-cfb931b5107a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing instance network info cache due to event network-changed-d2010228-e41b-4fe6-b814-cfb931b5107a. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] Acquiring lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] Acquired lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.network.neutron [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing network info cache for port d2010228-e41b-4fe6-b814-cfb931b5107a {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.network.neutron [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.network.neutron [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] Releasing lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-changed-e289552d-05b7-418b-97c2-7d13c956b3fa {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing instance network info cache due to event network-changed-e289552d-05b7-418b-97c2-7d13c956b3fa. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] Acquiring lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] Acquired lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.network.neutron [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing network info cache for port e289552d-05b7-418b-97c2-7d13c956b3fa {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.network.neutron [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.network.neutron [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] Releasing lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-changed-ee409ffe-08fa-490f-ab00-0c107a83ad39 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing instance network info cache due to event network-changed-ee409ffe-08fa-490f-ab00-0c107a83ad39. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] Acquiring lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] Acquired lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:13 user nova-compute[73520]: DEBUG nova.network.neutron [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing network info cache for port ee409ffe-08fa-490f-ab00-0c107a83ad39 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] Releasing lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-changed-2c8f553a-1fb2-4a3b-80dd-0d549112f793 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing instance network info cache due to event network-changed-2c8f553a-1fb2-4a3b-80dd-0d549112f793. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] Acquiring lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] Acquired lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing network info cache for port 2c8f553a-1fb2-4a3b-80dd-0d549112f793 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Successfully updated port: d2be9b32-5339-4e58-abd1-02cf8c09b9e2 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquired lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-abc343f0-88a8-4b15-b403-2a7e95e90f2b req-e84e0435-e7c8-48cb-8dac-513516bbb778 service nova] Releasing lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:14:14 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Successfully updated port: 43824ad0-ef35-4471-9ce5-ffedc9f3784a {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-changed-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing instance network info cache due to event network-changed-d2be9b32-5339-4e58-abd1-02cf8c09b9e2. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] Acquiring lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Successfully updated port: c60f87c0-2d15-4360-8fa0-bf406fff942d {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:14:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquired lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:14:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:14:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-f31d9b13-5b6e-4ad6-9b70-d5f56db27456 req-32f66682-e8a7-49d7-8e45-feb517077255 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-changed-c60f87c0-2d15-4360-8fa0-bf406fff942d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-f31d9b13-5b6e-4ad6-9b70-d5f56db27456 req-32f66682-e8a7-49d7-8e45-feb517077255 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing instance network info cache due to event network-changed-c60f87c0-2d15-4360-8fa0-bf406fff942d. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f31d9b13-5b6e-4ad6-9b70-d5f56db27456 req-32f66682-e8a7-49d7-8e45-feb517077255 service nova] Acquiring lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:18 user nova-compute[73520]: DEBUG nova.network.neutron [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [{"id": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "address": "fa:16:3e:49:3b:e0", "network": {"id": "742c040c-3528-4df9-9028-88841523fc19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1576139447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17b4d8a-28", "ovs_interfaceid": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "address": "fa:16:3e:5c:b7:6c", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48df8bb9-8a", "ovs_interfaceid": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2010228-e41b-4fe6-b814-cfb931b5107a", "address": "fa:16:3e:ed:da:23", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2010228-e4", "ovs_interfaceid": "d2010228-e41b-4fe6-b814-cfb931b5107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Releasing lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Instance network_info: |[{"id": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "address": "fa:16:3e:49:3b:e0", "network": {"id": "742c040c-3528-4df9-9028-88841523fc19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1576139447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17b4d8a-28", "ovs_interfaceid": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "address": "fa:16:3e:5c:b7:6c", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48df8bb9-8a", "ovs_interfaceid": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2010228-e41b-4fe6-b814-cfb931b5107a", "address": "fa:16:3e:ed:da:23", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2010228-e4", "ovs_interfaceid": "d2010228-e41b-4fe6-b814-cfb931b5107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:14:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] Acquired lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:18 user nova-compute[73520]: DEBUG nova.network.neutron [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing network info cache for port d2be9b32-5339-4e58-abd1-02cf8c09b9e2 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG nova.network.neutron [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updated VIF entry in instance network info cache for port d2be9b32-5339-4e58-abd1-02cf8c09b9e2. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG nova.network.neutron [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [{"id": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "address": "fa:16:3e:49:3b:e0", "network": {"id": "742c040c-3528-4df9-9028-88841523fc19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1576139447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17b4d8a-28", "ovs_interfaceid": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "address": "fa:16:3e:5c:b7:6c", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48df8bb9-8a", "ovs_interfaceid": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2010228-e41b-4fe6-b814-cfb931b5107a", "address": "fa:16:3e:ed:da:23", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2010228-e4", "ovs_interfaceid": "d2010228-e41b-4fe6-b814-cfb931b5107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] Releasing lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-changed-43824ad0-ef35-4471-9ce5-ffedc9f3784a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing instance network info cache due to event network-changed-43824ad0-ef35-4471-9ce5-ffedc9f3784a. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] Acquiring lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:19 user nova-compute[73520]: INFO nova.virt.block_device [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Booting with volume 5480195e-373a-4385-af13-1c5c8401ded9 at /dev/vdb
Aug 16 12:14:19 user nova-compute[73520]: DEBUG os_brick.utils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a13b2d-9561-4eaa-bd11-4a771e34b5b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5559356f-8bdd-4273-b645-e1e3717dfab6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d814bbe2-fb61-4bad-9f85-86ecb4fb5626]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d547d4f3-8e96-465e-8eba-8dcaa8dc6579]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:19 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:14:19 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5e9e26-1cd8-42e4-8d91-f75b467ad6be]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG os_brick.utils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:14:19 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating existing volume attachment record: 3b73a01f-5067-400d-815d-79cebabc547a {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:14:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [{"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "address": "fa:16:3e:4a:d3:74", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43824ad0-ef", "ovs_interfaceid": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "address": "fa:16:3e:d7:8c:a9", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60f87c0-2d", "ovs_interfaceid": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Releasing lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Instance network_info: |[{"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "address": "fa:16:3e:4a:d3:74", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43824ad0-ef", "ovs_interfaceid": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "address": "fa:16:3e:d7:8c:a9", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60f87c0-2d", "ovs_interfaceid": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:14:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f31d9b13-5b6e-4ad6-9b70-d5f56db27456 req-32f66682-e8a7-49d7-8e45-feb517077255 service nova] Acquired lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:20 user nova-compute[73520]: DEBUG nova.network.neutron [req-f31d9b13-5b6e-4ad6-9b70-d5f56db27456 req-32f66682-e8a7-49d7-8e45-feb517077255 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing network info cache for port c60f87c0-2d15-4360-8fa0-bf406fff942d {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:20 user nova-compute[73520]: DEBUG nova.network.neutron [req-f31d9b13-5b6e-4ad6-9b70-d5f56db27456 req-32f66682-e8a7-49d7-8e45-feb517077255 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updated VIF entry in instance network info cache for port c60f87c0-2d15-4360-8fa0-bf406fff942d. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:14:20 user nova-compute[73520]: DEBUG nova.network.neutron [req-f31d9b13-5b6e-4ad6-9b70-d5f56db27456 req-32f66682-e8a7-49d7-8e45-feb517077255 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [{"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "address": "fa:16:3e:4a:d3:74", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43824ad0-ef", "ovs_interfaceid": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "address": "fa:16:3e:d7:8c:a9", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60f87c0-2d", "ovs_interfaceid": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f31d9b13-5b6e-4ad6-9b70-d5f56db27456 req-32f66682-e8a7-49d7-8e45-feb517077255 service nova] Releasing lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] Acquired lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:20 user nova-compute[73520]: DEBUG nova.network.neutron [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing network info cache for port 43824ad0-ef35-4471-9ce5-ffedc9f3784a {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:21 user nova-compute[73520]: DEBUG nova.network.neutron [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updated VIF entry in instance network info cache for port 43824ad0-ef35-4471-9ce5-ffedc9f3784a. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:14:21 user nova-compute[73520]: DEBUG nova.network.neutron [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [{"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "address": "fa:16:3e:4a:d3:74", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43824ad0-ef", "ovs_interfaceid": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "address": "fa:16:3e:d7:8c:a9", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60f87c0-2d", "ovs_interfaceid": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-44870b06-7381-44eb-ae6a-16fb8ba3d2f7 req-fcbfc513-1b1f-4fb8-af22-d275b33ecc41 service nova] Releasing lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "9e339769-9db0-4fa3-b966-3cc1c2a24789" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG nova.objects.instance [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lazy-loading 'flavor' on Instance uuid 9e339769-9db0-4fa3-b966-3cc1c2a24789 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "9e339769-9db0-4fa3-b966-3cc1c2a24789" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:24 user nova-compute[73520]: INFO nova.compute.manager [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Attaching volume 02f32ae5-9854-444e-95fa-91ffa36971d9 to /dev/vdb
Aug 16 12:14:24 user nova-compute[73520]: DEBUG os_brick.utils [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0e0e0b-9e31-41f3-bf0a-ae71aaf431c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b224796-af03-4f51-a7b4-9f925306dbc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45efe38-4676-4779-8321-46e0265af914]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f88095-ed56-43e2-95a8-90067db04534]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:24 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7944a265-fd04-4d24-a9e3-53864864ed20]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG os_brick.utils [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Updating existing volume attachment record: 5c3b4f76-d250-4b46-bbe9-321c490a50c8 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:14:24 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:14:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:14:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:14:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:14:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:14:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:14:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:14:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:25 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:14:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json" returned: 0 in 0.414s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-7340779a-d916-490a-be52-d013577cfdef req-07d9871d-085a-4be1-b5ae-391b54f16531 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-changed-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-7340779a-d916-490a-be52-d013577cfdef req-07d9871d-085a-4be1-b5ae-391b54f16531 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Refreshing instance network info cache due to event network-changed-e7070f8b-1a15-4dad-8fac-bd4518007ed3. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7340779a-d916-490a-be52-d013577cfdef req-07d9871d-085a-4be1-b5ae-391b54f16531 service nova] Acquiring lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7340779a-d916-490a-be52-d013577cfdef req-07d9871d-085a-4be1-b5ae-391b54f16531 service nova] Acquired lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.network.neutron [req-7340779a-d916-490a-be52-d013577cfdef req-07d9871d-085a-4be1-b5ae-391b54f16531 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Refreshing network info cache for port e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:30 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:14:30 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=6957MB free_disk=25.693950653076172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 9e339769-9db0-4fa3-b966-3cc1c2a24789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 636510f6-acfa-4705-bfb1-03df3f9297be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1e35c753-7af1-4047-ad06-8b5755207b8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4ace588c-2910-477d-a2f1-259bea336e38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4ce719c9-0210-414f-bbf3-37bfa392125c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance c1492de2-3545-4ef7-bf3d-07e779d73f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1c83f328-2bad-4efa-98f1-2568dcf6a0c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2462cd5c-8c3b-49e6-82a9-6539c57edb1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ff7477c9-0c43-4aff-a7c3-e9311c965f40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d35ff623-3cb2-420f-98c6-9da333fa5cee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-f70d6711-b22c-43ee-9b1d-5d1d11969f08 req-1f4bb708-f665-498b-91e0-004dd4a16107 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Received event network-changed-ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-f70d6711-b22c-43ee-9b1d-5d1d11969f08 req-1f4bb708-f665-498b-91e0-004dd4a16107 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Refreshing instance network info cache due to event network-changed-ec555ffc-ecb2-48d7-8c11-d07a3238df5a. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f70d6711-b22c-43ee-9b1d-5d1d11969f08 req-1f4bb708-f665-498b-91e0-004dd4a16107 service nova] Acquiring lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f70d6711-b22c-43ee-9b1d-5d1d11969f08 req-1f4bb708-f665-498b-91e0-004dd4a16107 service nova] Acquired lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.network.neutron [req-f70d6711-b22c-43ee-9b1d-5d1d11969f08 req-1f4bb708-f665-498b-91e0-004dd4a16107 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Refreshing network info cache for port ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:14:30 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:14:31 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:14:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.720s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:31 user nova-compute[73520]: DEBUG nova.network.neutron [req-7340779a-d916-490a-be52-d013577cfdef req-07d9871d-085a-4be1-b5ae-391b54f16531 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updated VIF entry in instance network info cache for port e7070f8b-1a15-4dad-8fac-bd4518007ed3. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:14:31 user nova-compute[73520]: DEBUG nova.network.neutron [req-7340779a-d916-490a-be52-d013577cfdef req-07d9871d-085a-4be1-b5ae-391b54f16531 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updating instance_info_cache with network_info: [{"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7340779a-d916-490a-be52-d013577cfdef req-07d9871d-085a-4be1-b5ae-391b54f16531 service nova] Releasing lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:31 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:14:31 user nova-compute[73520]: DEBUG nova.network.neutron [req-f70d6711-b22c-43ee-9b1d-5d1d11969f08 req-1f4bb708-f665-498b-91e0-004dd4a16107 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updated VIF entry in instance network info cache for port ec555ffc-ecb2-48d7-8c11-d07a3238df5a. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:14:31 user nova-compute[73520]: DEBUG nova.network.neutron [req-f70d6711-b22c-43ee-9b1d-5d1d11969f08 req-1f4bb708-f665-498b-91e0-004dd4a16107 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updating instance_info_cache with network_info: [{"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:31 user nova-compute[73520]: INFO nova.compute.manager [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] instance snapshotting
Aug 16 12:14:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f70d6711-b22c-43ee-9b1d-5d1d11969f08 req-1f4bb708-f665-498b-91e0-004dd4a16107 service nova] Releasing lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:31 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Beginning live snapshot process
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json -f qcow2 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json -f qcow2 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:32 user nova-compute[73520]: INFO nova.virt.block_device [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Booting with volume 808e06ad-7957-4b4b-8a54-17dc3b0108af at /dev/vdc
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG os_brick.utils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updating instance_info_cache with network_info: [{"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07d2959-5dd8-4c21-a53d-5134b9583804]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[746b509f-27b9-43b0-a4f5-353dd2c93b00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[74738670-2393-4510-a7b3-697b838795d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[10307bb4-6436-49d8-99ae-ca0d67d429d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:32 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[092a7d74-93d2-4a71-8d14-da5a3e7766b5]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG os_brick.utils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating existing volume attachment record: 381dc4bd-faa4-410e-a880-34860466fefa {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq1p0ayjl/013213f2f9cc4b32a7d741aa69b739c2.delta 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq1p0ayjl/013213f2f9cc4b32a7d741aa69b739c2.delta 1073741824" returned: 0 in 0.050s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:32 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 12:14:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73520) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 16 12:14:32 user nova-compute[73520]: INFO nova.virt.libvirt.host [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] UEFI support detected
Aug 16 12:14:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] COPY block job progress, current cursor: 524288 final cursor: 75497472 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:14:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:14:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 12:14:34 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:14:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq1p0ayjl/013213f2f9cc4b32a7d741aa69b739c2.delta /opt/stack/data/nova/instances/snapshots/tmpq1p0ayjl/013213f2f9cc4b32a7d741aa69b739c2 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq1p0ayjl/013213f2f9cc4b32a7d741aa69b739c2.delta /opt/stack/data/nova/instances/snapshots/tmpq1p0ayjl/013213f2f9cc4b32a7d741aa69b739c2" returned: 0 in 0.474s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Snapshot extracted, beginning image upload
Aug 16 12:14:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:14:35 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHARNoIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:14:35 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:14:35 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:14:35 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:14:35 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:14:35 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:14:35 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:14:35 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:14:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:35 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[307639d8-b52d-40ec-af5e-63dcd2855478]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:35 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:14:35 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae9ddc4-d1ea-454b-8fc0-2afb3460eee5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9] added
Aug 16 12:14:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[556ce9f8-01bf-4d46-8cab-56de35bc304a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50d1579-80a8-4607-9e5c-9b44a5db542c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BHARNoIj {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BHARNoIj" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bd1d7a-732a-4c96-bc75-5499157025e1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BHARNoIj'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d1e54a-de71-402d-9289-cf5b27b6da7b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a516a42c-0578-4fd5-bdf8-e3c32536244a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d2ae0e-df2d-486f-be3b-47143c0a3435]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9, portal: 172.16.0.220,3260]
Aug 16 12:14:36 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9, portal: 172.16.0.220,3260] successful.
Aug 16 12:14:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[14427792-e07d-4046-a1d7-f7e69cfff9e8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b530f802-9495-4b3f-8dae-3680df715d18]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:36 user nova-compute[73520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 (non-flash)
Aug 16 12:14:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:36 user nova-compute[73520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 (non-flash)
Aug 16 12:14:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[47194f06-c7c4-4928-863d-509cb9079b0b]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHARNoIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-9f0c496b-221c-45f3-987c-17f7f365e54b req-6b659f12-3deb-4b75-a00f-96377cc5b091 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Received event network-changed-8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-9f0c496b-221c-45f3-987c-17f7f365e54b req-6b659f12-3deb-4b75-a00f-96377cc5b091 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Refreshing instance network info cache due to event network-changed-8752a2b2-4922-4822-ad90-f0a98e749b9f. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9f0c496b-221c-45f3-987c-17f7f365e54b req-6b659f12-3deb-4b75-a00f-96377cc5b091 service nova] Acquiring lock "refresh_cache-636510f6-acfa-4705-bfb1-03df3f9297be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9f0c496b-221c-45f3-987c-17f7f365e54b req-6b659f12-3deb-4b75-a00f-96377cc5b091 service nova] Acquired lock "refresh_cache-636510f6-acfa-4705-bfb1-03df3f9297be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:36 user nova-compute[73520]: DEBUG nova.network.neutron [req-9f0c496b-221c-45f3-987c-17f7f365e54b req-6b659f12-3deb-4b75-a00f-96377cc5b091 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Refreshing network info cache for port 8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:37 user nova-compute[73520]: DEBUG nova.network.neutron [req-9f0c496b-221c-45f3-987c-17f7f365e54b req-6b659f12-3deb-4b75-a00f-96377cc5b091 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Updated VIF entry in instance network info cache for port 8752a2b2-4922-4822-ad90-f0a98e749b9f. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:14:37 user nova-compute[73520]: DEBUG nova.network.neutron [req-9f0c496b-221c-45f3-987c-17f7f365e54b req-6b659f12-3deb-4b75-a00f-96377cc5b091 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Updating instance_info_cache with network_info: [{"id": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "address": "fa:16:3e:da:67:8e", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8752a2b2-49", "ovs_interfaceid": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9f0c496b-221c-45f3-987c-17f7f365e54b req-6b659f12-3deb-4b75-a00f-96377cc5b091 service nova] Releasing lock "refresh_cache-636510f6-acfa-4705-bfb1-03df3f9297be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:14:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23535303066653666', 'path': '/dev/sdc'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:14:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535303066653666', 'path': '/dev/sdc'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:14:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lazy-loading 'flavor' on Instance uuid 9e339769-9db0-4fa3-b966-3cc1c2a24789 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:14:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:14:37 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:14:37 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:14:37 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:14:37 user nova-compute[73520]:   <serial>02f32ae5-9854-444e-95fa-91ffa36971d9</serial>
Aug 16 12:14:37 user nova-compute[73520]: </disk>
Aug 16 12:14:37 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:14:37 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Snapshot image upload complete
Aug 16 12:14:37 user nova-compute[73520]: INFO nova.compute.manager [None req-2c3c65f4-6bf2-41c5-af62-fd67755973b5 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Took 5.73 seconds to snapshot the instance on the hypervisor.
Aug 16 12:14:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:14:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:14:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] No VIF found with MAC fa:16:3e:9f:95:73, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:14:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8cdbee70-1360-4fc0-b8f0-9d00883a4386 tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.298s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "9e339769-9db0-4fa3-b966-3cc1c2a24789" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:38 user nova-compute[73520]: INFO nova.compute.manager [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Terminating instance
Aug 16 12:14:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-b836876d-920e-4f14-825a-26ce82fa01e9 req-a72f544d-a344-4f34-8b85-a689dd78f7f3 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Received event network-vif-unplugged-b98fbde0-e7c2-4038-b436-57567ad76754 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b836876d-920e-4f14-825a-26ce82fa01e9 req-a72f544d-a344-4f34-8b85-a689dd78f7f3 service nova] Acquiring lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b836876d-920e-4f14-825a-26ce82fa01e9 req-a72f544d-a344-4f34-8b85-a689dd78f7f3 service nova] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b836876d-920e-4f14-825a-26ce82fa01e9 req-a72f544d-a344-4f34-8b85-a689dd78f7f3 service nova] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-b836876d-920e-4f14-825a-26ce82fa01e9 req-a72f544d-a344-4f34-8b85-a689dd78f7f3 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] No waiting events found dispatching network-vif-unplugged-b98fbde0-e7c2-4038-b436-57567ad76754 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:14:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-b836876d-920e-4f14-825a-26ce82fa01e9 req-a72f544d-a344-4f34-8b85-a689dd78f7f3 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Received event network-vif-unplugged-b98fbde0-e7c2-4038-b436-57567ad76754 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:39 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Instance destroyed successfully.
Aug 16 12:14:39 user nova-compute[73520]: DEBUG nova.objects.instance [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lazy-loading 'resources' on Instance uuid 9e339769-9db0-4fa3-b966-3cc1c2a24789 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1703936356',display_name='tempest-DeleteServersTestJSON-server-1703936356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1703936356',id=1,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:12:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06a6719264f84d308785e48fbca9ee31',ramdisk_id='',reservation_id='r-5tgibv09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1976385223',owner_user_name='tempest-DeleteServersTestJSON-1976385223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:12:45Z,user_data=None,user_id='1ad9c789ec514d6ebe3414865ba8ef92',uuid=9e339769-9db0-4fa3-b966-3cc1c2a24789,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b98fbde0-e7c2-4038-b436-57567ad76754", "address": "fa:16:3e:9f:95:73", "network": {"id": "c508e024-e875-4ffb-9945-d6ef43b597d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-953780218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a6719264f84d308785e48fbca9ee31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98fbde0-e7", "ovs_interfaceid": "b98fbde0-e7c2-4038-b436-57567ad76754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Converting VIF {"id": "b98fbde0-e7c2-4038-b436-57567ad76754", "address": "fa:16:3e:9f:95:73", "network": {"id": "c508e024-e875-4ffb-9945-d6ef43b597d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-953780218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06a6719264f84d308785e48fbca9ee31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98fbde0-e7", "ovs_interfaceid": "b98fbde0-e7c2-4038-b436-57567ad76754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:95:73,bridge_name='br-int',has_traffic_filtering=True,id=b98fbde0-e7c2-4038-b436-57567ad76754,network=Network(c508e024-e875-4ffb-9945-d6ef43b597d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98fbde0-e7') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_vif [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:95:73,bridge_name='br-int',has_traffic_filtering=True,id=b98fbde0-e7c2-4038-b436-57567ad76754,network=Network(c508e024-e875-4ffb-9945-d6ef43b597d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98fbde0-e7') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb98fbde0-e7, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:14:39 user nova-compute[73520]: INFO os_vif [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:95:73,bridge_name='br-int',has_traffic_filtering=True,id=b98fbde0-e7c2-4038-b436-57567ad76754,network=Network(c508e024-e875-4ffb-9945-d6ef43b597d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98fbde0-e7')
Aug 16 12:14:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHARNoIj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:14:39 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[750715a7-e664-47b0-bcab-9b70aa01dabe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaff1fb7-dace-43ca-821c-f7598df62645]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:39 user nova-compute[73520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 (non-flash)
Aug 16 12:14:39 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:39 user nova-compute[73520]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 (non-flash)
Aug 16 12:14:39 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c7270a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9'): ({'sdc'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Removing single pathed devices sdc {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5752b2c8-a8ff-4ea5-8f25-7debf72e0810]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[802151cd-cbb3-4a8e-8172-70f6d2c9707e]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Flushing IO for device /dev/sdc {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef68420-9617-4a54-9f0a-790c57b2636b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f280e9d8-81ea-4060-8a50-dc18ff2bda02]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b0e4f7-9ee5-48de-8ef2-e3da83bbeee4]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cfdf31-f524-41ef-8182-bf2fe0fe8b8b]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9, portal: 172.16.0.220,3260]
Aug 16 12:14:39 user nova-compute[73520]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9, portal: 172.16.0.220,3260] successful.
Aug 16 12:14:39 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02f32ae5-9854-444e-95fa-91ffa36971d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bb0409-e5e6-4533-aecf-cc567c1d7fd7]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] <== disconnect_volume: return (255ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:14:39 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Deleting instance files /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789_del
Aug 16 12:14:39 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Deletion of /opt/stack/data/nova/instances/9e339769-9db0-4fa3-b966-3cc1c2a24789_del complete
Aug 16 12:14:39 user nova-compute[73520]: INFO nova.compute.manager [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 16 12:14:39 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:14:39 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:40 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Took 0.59 seconds to deallocate network for instance.
Aug 16 12:14:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-19e9f0a7-9243-41ca-afa6-a13e894066d6 req-3b39ebe1-12f4-4728-958c-74ff550167a0 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Received event network-vif-deleted-b98fbde0-e7c2-4038-b436-57567ad76754 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:40 user nova-compute[73520]: INFO nova.compute.manager [req-19e9f0a7-9243-41ca-afa6-a13e894066d6 req-3b39ebe1-12f4-4728-958c-74ff550167a0 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Neutron deleted interface b98fbde0-e7c2-4038-b436-57567ad76754; detaching it from the instance and deleting it from the info cache
Aug 16 12:14:40 user nova-compute[73520]: DEBUG nova.network.neutron [req-19e9f0a7-9243-41ca-afa6-a13e894066d6 req-3b39ebe1-12f4-4728-958c-74ff550167a0 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-19e9f0a7-9243-41ca-afa6-a13e894066d6 req-3b39ebe1-12f4-4728-958c-74ff550167a0 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Detach interface failed, port_id=b98fbde0-e7c2-4038-b436-57567ad76754, reason: Instance 9e339769-9db0-4fa3-b966-3cc1c2a24789 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:14:40 user nova-compute[73520]: INFO nova.virt.block_device [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Booting with volume 1ca61a09-f1a6-438d-b4ef-2ca571993add at /dev/vdc
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "636510f6-acfa-4705-bfb1-03df3f9297be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "636510f6-acfa-4705-bfb1-03df3f9297be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG nova.objects.instance [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'flavor' on Instance uuid 636510f6-acfa-4705-bfb1-03df3f9297be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG os_brick.utils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "636510f6-acfa-4705-bfb1-03df3f9297be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a929bb-d51d-42ec-a3ee-3eaeceb490e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[83986f63-9a4c-432a-802d-4ec7bbfadade]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3415b8f-d641-4988-a4d7-2df48c9695b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3b2996-f8dc-48f7-8774-17786bb721ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:40 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0472fedf-5c8c-4f4e-ba45-99bc87658e86]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG os_brick.utils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating existing volume attachment record: d407fc1c-4694-48d1-a17b-29714e239bcd {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "636510f6-acfa-4705-bfb1-03df3f9297be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "636510f6-acfa-4705-bfb1-03df3f9297be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:40 user nova-compute[73520]: INFO nova.compute.manager [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Attaching volume eed03927-73a8-4479-8c02-236d471ead4f to /dev/vdb
Aug 16 12:14:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d528115-e1c3-4e97-a2ff-4e8d1074af64 req-23a61432-e48d-4a93-a572-15314cbfe562 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Received event network-vif-plugged-b98fbde0-e7c2-4038-b436-57567ad76754 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d528115-e1c3-4e97-a2ff-4e8d1074af64 req-23a61432-e48d-4a93-a572-15314cbfe562 service nova] Acquiring lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d528115-e1c3-4e97-a2ff-4e8d1074af64 req-23a61432-e48d-4a93-a572-15314cbfe562 service nova] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d528115-e1c3-4e97-a2ff-4e8d1074af64 req-23a61432-e48d-4a93-a572-15314cbfe562 service nova] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d528115-e1c3-4e97-a2ff-4e8d1074af64 req-23a61432-e48d-4a93-a572-15314cbfe562 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] No waiting events found dispatching network-vif-plugged-b98fbde0-e7c2-4038-b436-57567ad76754 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:14:41 user nova-compute[73520]: WARNING nova.compute.manager [req-9d528115-e1c3-4e97-a2ff-4e8d1074af64 req-23a61432-e48d-4a93-a572-15314cbfe562 service nova] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Received unexpected event network-vif-plugged-b98fbde0-e7c2-4038-b436-57567ad76754 for instance with vm_state active and task_state deleting.
Aug 16 12:14:41 user nova-compute[73520]: INFO nova.compute.manager [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Took 0.78 seconds to detach 1 volumes for instance.
Aug 16 12:14:41 user nova-compute[73520]: DEBUG os_brick.utils [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[825e82dd-8149-451b-ad93-cde62646cf38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e0d102-0a59-427e-8818-67954c4f5c0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bfe6e3-7235-48aa-886d-25e7e3060b48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1900b2-6cb6-4892-b560-9efc064a2aaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:41 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c594b837-17d7-43ad-9fa3-1244de769d89]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG os_brick.utils [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Updating existing volume attachment record: be05b07b-fbe9-4b54-8a55-accf9d018898 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:41 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Deleted allocations for instance 9e339769-9db0-4fa3-b966-3cc1c2a24789
Aug 16 12:14:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a1c34226-7511-4dbc-8979-2e39ad62833d tempest-DeleteServersTestJSON-1976385223 tempest-DeleteServersTestJSON-1976385223-project-member] Lock "9e339769-9db0-4fa3-b966-3cc1c2a24789" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.154s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-41714e83-e98a-483c-8ab8-b7d08dd69359 req-6141aaa3-74e1-4ac3-9967-ac285c1b1eb0 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Received event network-changed-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-41714e83-e98a-483c-8ab8-b7d08dd69359 req-6141aaa3-74e1-4ac3-9967-ac285c1b1eb0 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Refreshing instance network info cache due to event network-changed-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-41714e83-e98a-483c-8ab8-b7d08dd69359 req-6141aaa3-74e1-4ac3-9967-ac285c1b1eb0 service nova] Acquiring lock "refresh_cache-1e35c753-7af1-4047-ad06-8b5755207b8e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-41714e83-e98a-483c-8ab8-b7d08dd69359 req-6141aaa3-74e1-4ac3-9967-ac285c1b1eb0 service nova] Acquired lock "refresh_cache-1e35c753-7af1-4047-ad06-8b5755207b8e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:51 user nova-compute[73520]: DEBUG nova.network.neutron [req-41714e83-e98a-483c-8ab8-b7d08dd69359 req-6141aaa3-74e1-4ac3-9967-ac285c1b1eb0 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Refreshing network info cache for port 9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htmqQvWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:14:52 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:14:52 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:14:52 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[660d9406-283c-4e5e-a8e9-dda221b6e049]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:14:52 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[004773a9-96d6-4eb1-8935-277c7c4ac1df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f] added
Aug 16 12:14:52 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d417a640-a748-4d03-9aa8-096faa2bbd29]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4b8275-1a75-482d-aee6-ba21dfc6cd5f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v htmqQvWC {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v htmqQvWC" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd7a933-d49f-4867-9dd4-6697d72c8e65]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'htmqQvWC'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4016d2-c8a1-4f3a-ae4e-ae54968dc8c8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11d7b0a-bed0-4131-a273-73e7a1376ae3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:52 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:52 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3354ee-2289-4562-95d5-898fe02b0b89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f, portal: 172.16.0.220,3260]
Aug 16 12:14:52 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f, portal: 172.16.0.220,3260] successful.
Aug 16 12:14:52 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c0c79e-f02a-4150-9d19-543ebe119036]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7657e3b1-b20e-4359-b873-44f11b4c94e7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:52 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:52 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:52 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:52 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[986485c9-b8ce-4e8b-b2d7-6713584d9e14]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htmqQvWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG nova.network.neutron [req-41714e83-e98a-483c-8ab8-b7d08dd69359 req-6141aaa3-74e1-4ac3-9967-ac285c1b1eb0 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Updated VIF entry in instance network info cache for port 9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG nova.network.neutron [req-41714e83-e98a-483c-8ab8-b7d08dd69359 req-6141aaa3-74e1-4ac3-9967-ac285c1b1eb0 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Updating instance_info_cache with network_info: [{"id": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "address": "fa:16:3e:1f:c7:00", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9436b2f8-8b", "ovs_interfaceid": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:14:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-41714e83-e98a-483c-8ab8-b7d08dd69359 req-6141aaa3-74e1-4ac3-9967-ac285c1b1eb0 service nova] Releasing lock "refresh_cache-1e35c753-7af1-4047-ad06-8b5755207b8e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:14:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:53 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:14:53 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23762363832366365', 'path': '/dev/sdc'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:14:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762363832366365', 'path': '/dev/sdc'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:14:53 user nova-compute[73520]: DEBUG nova.objects.instance [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'flavor' on Instance uuid 636510f6-acfa-4705-bfb1-03df3f9297be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:14:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:14:53 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:14:53 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:14:53 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:14:53 user nova-compute[73520]:   <serial>eed03927-73a8-4479-8c02-236d471ead4f</serial>
Aug 16 12:14:53 user nova-compute[73520]: </disk>
Aug 16 12:14:53 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No VIF found with MAC fa:16:3e:da:67:8e, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:14:54 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Creating image(s)
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Ensure instance console log exists: /opt/stack/data/nova/instances/d35ff623-3cb2-420f-98c6-9da333fa5cee/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Start _get_guest_xml network_info=[{"id": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "address": "fa:16:3e:49:3b:e0", "network": {"id": "742c040c-3528-4df9-9028-88841523fc19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1576139447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17b4d8a-28", "ovs_interfaceid": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "address": "fa:16:3e:5c:b7:6c", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48df8bb9-8a", "ovs_interfaceid": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2010228-e41b-4fe6-b814-cfb931b5107a", "address": "fa:16:3e:ed:da:23", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2010228-e4", "ovs_interfaceid": "d2010228-e41b-4fe6-b814-cfb931b5107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWRFymLf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd35ff623-3cb2-420f-98c6-9da333fa5cee', 'attached_at': '', 'detached_at': '', 'volume_id': 'd21b2a79-9685-465d-8aa3-a36c978d53dc', 'serial': 'd21b2a79-9685-465d-8aa3-a36c978d53dc'}, 'attachment_id': '55846f8e-6e6c-469c-9a70-1e504ab35686', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKgnkxvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd35ff623-3cb2-420f-98c6-9da333fa5cee', 'attached_at': '', 'detached_at': '', 'volume_id': 'a12dc311-b21c-47af-84b7-1d5dc129e45a', 'serial': 'a12dc311-b21c-47af-84b7-1d5dc129e45a'}, 'attachment_id': 'f02b860a-f0be-4522-99bf-2318e2615e0b', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtwTAFxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd35ff623-3cb2-420f-98c6-9da333fa5cee', 'attached_at': '', 'detached_at': '', 'volume_id': '808e06ad-7957-4b4b-8a54-17dc3b0108af', 'serial': '808e06ad-7957-4b4b-8a54-17dc3b0108af'}, 'attachment_id': '381dc4bd-faa4-410e-a880-34860466fefa', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:14:54 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:14:54 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWRFymLf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:14:54 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:14:54 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:14:54 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cde665-e1ef-4d60-97f6-87935d10d6d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:14:54 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc462563-3615-40c7-b8a2-1c9cd00a009f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "636510f6-acfa-4705-bfb1-03df3f9297be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.372s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f7d8de-6c2a-4205-a072-dd1b38bdffc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc] added
Aug 16 12:14:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdb3905-ec7c-42fa-bfa1-16ab15b42f0b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5de972-86d7-4311-ae7b-a2720bb582e6]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWRFymLf {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWRFymLf" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd5ab7c-e770-4c9c-9753-dfb0b6c69dbe]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oWRFymLf'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa8453d-c11e-4d92-8b50-1f21773e92b4]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188079.332654, 9e339769-9db0-4fa3-b966-3cc1c2a24789 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:14:54 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] VM Stopped (Lifecycle Event)
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10a5d1b-f71e-46e2-a619-6d480dd62311]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:54 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:54 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6a480b8e-70f2-484c-bc9e-7f5db7015fff None None] [instance: 9e339769-9db0-4fa3-b966-3cc1c2a24789] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fa0f49-8103-4441-a882-9d2b97b7562c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc, portal: 172.16.0.220,3260]
Aug 16 12:14:54 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc, portal: 172.16.0.220,3260] successful.
Aug 16 12:14:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12371f8-bc66-454d-a7e0-ce7e034af695]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbc3cca-45ae-429e-b9b9-e4f715727b00]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:54 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:54 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:14:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:54 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:54 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:14:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.682s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e53666e-bec5-49d0-a701-d63aecfae4be]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:54 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWRFymLf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.713s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] <== connect_volume: return (1714ms) {'type': 'block', 'scsi_wwn': '23031653739386664', 'path': '/dev/sdd'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031653739386664', 'path': '/dev/sdd'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKgnkxvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:14:55 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:14:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:14:55 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:14:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:14:55 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:14:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[180c94f3-c73f-436c-a742-8bcf718e8b33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:14:55 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b028b752-336e-4d24-b115-99f8ec0e7305]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a] added
Aug 16 12:14:55 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a893599c-b718-4242-956c-0f6842717762]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a1b219-6fb3-4470-b9d4-1e1942c6f1fb]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKgnkxvb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKgnkxvb" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb1018d-9363-4349-84cc-741a69b5ddfa]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IKgnkxvb'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2432eb94-c12d-4174-9a47-1097e6094420]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aa9242-dcb7-417f-98a9-111b5f24ce49]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:56 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:56 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:14:56 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:56 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:56 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:14:56 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[184bdbda-8754-4d81-a5b7-7ed5af0d717d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a, portal: 172.16.0.220,3260]
Aug 16 12:14:56 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a, portal: 172.16.0.220,3260] successful.
Aug 16 12:14:56 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3cc42a-dcb4-4790-9da7-23efdae6992a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07829f3-95b6-43a4-bf57-34bbba4f2baf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:56 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:56 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:14:56 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:14:56 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:56 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:56 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:14:56 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:14:56 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[afde3372-7721-45d6-a2ba-2d7ad7ea5150]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:14:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKgnkxvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "1e35c753-7af1-4047-ad06-8b5755207b8e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG nova.objects.instance [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lazy-loading 'flavor' on Instance uuid 1e35c753-7af1-4047-ad06-8b5755207b8e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23532656266663135', 'path': '/dev/sde'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532656266663135', 'path': '/dev/sde'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "1e35c753-7af1-4047-ad06-8b5755207b8e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:57 user nova-compute[73520]: INFO nova.compute.manager [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Attaching volume 8e2eb1e7-3e56-4952-abcb-74aad936e981 to /dev/vdb
Aug 16 12:14:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtwTAFxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:14:57 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:14:57 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:14:57 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7530b992-95f5-4364-8c97-16258009faa0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:14:57 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:14:57 user nova-compute[73520]: INFO nova.compute.claims [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Claim successful on node user
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcce9d0-f3f9-4101-a7c4-7957d83b05d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af] added
Aug 16 12:14:57 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.utils [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfbcc49-9026-4cdb-93b3-b0e8d07a41e7]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaa2684-1d4b-4d89-ac68-862434150df2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7509a057-bcff-413c-903a-8e9744e32f20]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dtwTAFxl {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d43a23-f88a-49ea-bb4b-ee76edf5e95a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dtwTAFxl" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d695d3-4147-4acd-85b1-d0e50c6e9208]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dtwTAFxl'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4939ef6a-2139-41eb-8114-9cbb9b07c323]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[09986d72-1b96-4ef3-81c2-d149bf1c3e94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5e4e67-5353-4439-aba6-d1325d6182b0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:14:57 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65f139a-0c4e-444b-b0af-3a9d08a3c981]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.utils [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Updating existing volume attachment record: b01d8469-8f10-4acd-bc30-83da233ec4b1 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51e22ad-515e-4a7c-8108-c47185f1e97e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:14:57 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:14:57 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b93bb2-7f1e-469d-8193-569b0278fd17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af, portal: 172.16.0.220,3260]
Aug 16 12:14:57 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af, portal: 172.16.0.220,3260] successful.
Aug 16 12:14:57 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2999fd-3a29-43ac-94b3-519d0be0134e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8663d95a-00b2-44a1-b79b-fc131f720799]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:14:57 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:14:57 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:14:57 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dda02d-58d0-4aa0-bfa4-73816bcedc19]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtwTAFxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:14:57 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.824s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:14:58 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.policy [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6426c917725745038fdb1d03fec4a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1059841e2ee04ca4870497a1ec60bcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:14:58 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Creating image(s)
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "/opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "/opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '26631306433386333', 'path': '/dev/sdf'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631306433386333', 'path': '/dev/sdf'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "address": "fa:16:3e:49:3b:e0", "network": {"id": "742c040c-3528-4df9-9028-88841523fc19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1576139447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17b4d8a-28", "ovs_interfaceid": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "address": "fa:16:3e:49:3b:e0", "network": {"id": "742c040c-3528-4df9-9028-88841523fc19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1576139447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17b4d8a-28", "ovs_interfaceid": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:e0,bridge_name='br-int',has_traffic_filtering=True,id=a17b4d8a-28aa-450d-b11c-6254f52c9cbb,network=Network(742c040c-3528-4df9-9028-88841523fc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17b4d8a-28') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=16cf4ff6-8636-43c0-95c6-8cd845011d8f,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16cf4ff6-86') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=c775e42a-3c5e-456f-ba77-911c8dc4aa93,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc775e42a-3c') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "address": "fa:16:3e:5c:b7:6c", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48df8bb9-8a", "ovs_interfaceid": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "address": "fa:16:3e:5c:b7:6c", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48df8bb9-8a", "ovs_interfaceid": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b7:6c,bridge_name='br-int',has_traffic_filtering=True,id=48df8bb9-8a61-49bd-b0b0-7a4b56b87660,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48df8bb9-8a') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2010228-e41b-4fe6-b814-cfb931b5107a", "address": "fa:16:3e:ed:da:23", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2010228-e4", "ovs_interfaceid": "d2010228-e41b-4fe6-b814-cfb931b5107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "d2010228-e41b-4fe6-b814-cfb931b5107a", "address": "fa:16:3e:ed:da:23", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2010228-e4", "ovs_interfaceid": "d2010228-e41b-4fe6-b814-cfb931b5107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:da:23,bridge_name='br-int',has_traffic_filtering=True,id=d2010228-e41b-4fe6-b814-cfb931b5107a,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2010228-e4') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=ee409ffe-08fa-490f-ab00-0c107a83ad39,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee409ffe-08') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d2be9b32-5339-4e58-abd1-02cf8c09b9e2,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9b32-53') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.objects.instance [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lazy-loading 'pci_devices' on Instance uuid d35ff623-3cb2-420f-98c6-9da333fa5cee {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:14:58 user nova-compute[73520]:   <uuid>d35ff623-3cb2-420f-98c6-9da333fa5cee</uuid>
Aug 16 12:14:58 user nova-compute[73520]:   <name>instance-0000000b</name>
Aug 16 12:14:58 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:14:58 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:14:58 user nova-compute[73520]:   <metadata>
Aug 16 12:14:58 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:14:58 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:14:58 user nova-compute[73520]:       <nova:name>tempest-device-tagging-server-1465012288</nova:name>
Aug 16 12:14:58 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:14:54</nova:creationTime>
Aug 16 12:14:58 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:14:58 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:14:58 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:14:58 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:14:58 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:14:58 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:14:58 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:14:58 user nova-compute[73520]:       <nova:owner>
Aug 16 12:14:58 user nova-compute[73520]:         <nova:user uuid="c2f6368a69254d3fa9b4d8e9f725569c">tempest-TaggedBootDevicesTest-1030514499-project-member</nova:user>
Aug 16 12:14:58 user nova-compute[73520]:         <nova:project uuid="d7e591da95a84cb0b3c2e42ff63b13ae">tempest-TaggedBootDevicesTest-1030514499</nova:project>
Aug 16 12:14:58 user nova-compute[73520]:       </nova:owner>
Aug 16 12:14:58 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:14:58 user nova-compute[73520]:       <nova:ports>
Aug 16 12:14:58 user nova-compute[73520]:         <nova:port uuid="a17b4d8a-28aa-450d-b11c-6254f52c9cbb">
Aug 16 12:14:58 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 12:14:58 user nova-compute[73520]:         </nova:port>
Aug 16 12:14:58 user nova-compute[73520]:         <nova:port uuid="16cf4ff6-8636-43c0-95c6-8cd845011d8f">
Aug 16 12:14:58 user nova-compute[73520]:           <nova:ip type="fixed" address="10.1.1.93" ipVersion="4"/>
Aug 16 12:14:58 user nova-compute[73520]:         </nova:port>
Aug 16 12:14:58 user nova-compute[73520]:         <nova:port uuid="c775e42a-3c5e-456f-ba77-911c8dc4aa93">
Aug 16 12:14:58 user nova-compute[73520]:           <nova:ip type="fixed" address="10.1.1.89" ipVersion="4"/>
Aug 16 12:14:58 user nova-compute[73520]:         </nova:port>
Aug 16 12:14:58 user nova-compute[73520]:         <nova:port uuid="48df8bb9-8a61-49bd-b0b0-7a4b56b87660">
Aug 16 12:14:58 user nova-compute[73520]:           <nova:ip type="fixed" address="10.1.1.98" ipVersion="4"/>
Aug 16 12:14:58 user nova-compute[73520]:         </nova:port>
Aug 16 12:14:58 user nova-compute[73520]:         <nova:port uuid="d2010228-e41b-4fe6-b814-cfb931b5107a">
Aug 16 12:14:58 user nova-compute[73520]:           <nova:ip type="fixed" address="10.1.1.165" ipVersion="4"/>
Aug 16 12:14:58 user nova-compute[73520]:         </nova:port>
Aug 16 12:14:58 user nova-compute[73520]:         <nova:port uuid="ee409ffe-08fa-490f-ab00-0c107a83ad39">
Aug 16 12:14:58 user nova-compute[73520]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 12:14:58 user nova-compute[73520]:         </nova:port>
Aug 16 12:14:58 user nova-compute[73520]:         <nova:port uuid="d2be9b32-5339-4e58-abd1-02cf8c09b9e2">
Aug 16 12:14:58 user nova-compute[73520]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 12:14:58 user nova-compute[73520]:         </nova:port>
Aug 16 12:14:58 user nova-compute[73520]:       </nova:ports>
Aug 16 12:14:58 user nova-compute[73520]:     </nova:instance>
Aug 16 12:14:58 user nova-compute[73520]:   </metadata>
Aug 16 12:14:58 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:14:58 user nova-compute[73520]:     <system>
Aug 16 12:14:58 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:14:58 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:14:58 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:14:58 user nova-compute[73520]:       <entry name="serial">d35ff623-3cb2-420f-98c6-9da333fa5cee</entry>
Aug 16 12:14:58 user nova-compute[73520]:       <entry name="uuid">d35ff623-3cb2-420f-98c6-9da333fa5cee</entry>
Aug 16 12:14:58 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:14:58 user nova-compute[73520]:     </system>
Aug 16 12:14:58 user nova-compute[73520]:   </sysinfo>
Aug 16 12:14:58 user nova-compute[73520]:   <os>
Aug 16 12:14:58 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:14:58 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:14:58 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:14:58 user nova-compute[73520]:   </os>
Aug 16 12:14:58 user nova-compute[73520]:   <features>
Aug 16 12:14:58 user nova-compute[73520]:     <acpi/>
Aug 16 12:14:58 user nova-compute[73520]:     <apic/>
Aug 16 12:14:58 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:14:58 user nova-compute[73520]:   </features>
Aug 16 12:14:58 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:14:58 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:14:58 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:14:58 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:14:58 user nova-compute[73520]:   </clock>
Aug 16 12:14:58 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:14:58 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:14:58 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:14:58 user nova-compute[73520]:   </cpu>
Aug 16 12:14:58 user nova-compute[73520]:   <devices>
Aug 16 12:14:58 user nova-compute[73520]:     <disk type="file" device="cdrom">
Aug 16 12:14:58 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 12:14:58 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/d35ff623-3cb2-420f-98c6-9da333fa5cee/disk.config"/>
Aug 16 12:14:58 user nova-compute[73520]:       <target dev="hda" bus="ide"/>
Aug 16 12:14:58 user nova-compute[73520]:     </disk>
Aug 16 12:14:58 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:14:58 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:14:58 user nova-compute[73520]:       <source dev="/dev/sdd"/>
Aug 16 12:14:58 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:14:58 user nova-compute[73520]:       <serial>d21b2a79-9685-465d-8aa3-a36c978d53dc</serial>
Aug 16 12:14:58 user nova-compute[73520]:     </disk>
Aug 16 12:14:58 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:14:58 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:14:58 user nova-compute[73520]:       <source dev="/dev/sde"/>
Aug 16 12:14:58 user nova-compute[73520]:       <target dev="vdb" bus="virtio"/>
Aug 16 12:14:58 user nova-compute[73520]:       <serial>a12dc311-b21c-47af-84b7-1d5dc129e45a</serial>
Aug 16 12:14:58 user nova-compute[73520]:     </disk>
Aug 16 12:14:58 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:14:58 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:14:58 user nova-compute[73520]:       <source dev="/dev/sdf"/>
Aug 16 12:14:58 user nova-compute[73520]:       <target dev="vdc" bus="virtio"/>
Aug 16 12:14:58 user nova-compute[73520]:       <serial>808e06ad-7957-4b4b-8a54-17dc3b0108af</serial>
Aug 16 12:14:58 user nova-compute[73520]:     </disk>
Aug 16 12:14:58 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:14:58 user nova-compute[73520]:       <mac address="fa:16:3e:49:3b:e0"/>
Aug 16 12:14:58 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:14:58 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:14:58 user nova-compute[73520]:       <target dev="tapa17b4d8a-28"/>
Aug 16 12:14:58 user nova-compute[73520]:     </interface>
Aug 16 12:14:58 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:14:58 user nova-compute[73520]:       <mac address="fa:16:3e:71:d9:37"/>
Aug 16 12:14:58 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:14:58 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:14:58 user nova-compute[73520]:       <target dev="tap16cf4ff6-86"/>
Aug 16 12:14:58 user nova-compute[73520]:     </interface>
Aug 16 12:14:58 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:14:58 user nova-compute[73520]:       <mac address="fa:16:3e:31:16:a5"/>
Aug 16 12:14:58 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:14:58 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:14:58 user nova-compute[73520]:       <target dev="tapc775e42a-3c"/>
Aug 16 12:14:58 user nova-compute[73520]:     </interface>
Aug 16 12:14:58 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:14:58 user nova-compute[73520]:       <mac address="fa:16:3e:5c:b7:6c"/>
Aug 16 12:14:58 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:14:58 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:14:58 user nova-compute[73520]:       <target dev="tap48df8bb9-8a"/>
Aug 16 12:14:58 user nova-compute[73520]:     </interface>
Aug 16 12:14:58 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:14:58 user nova-compute[73520]:       <mac address="fa:16:3e:ed:da:23"/>
Aug 16 12:14:58 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:14:58 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:14:58 user nova-compute[73520]:       <target dev="tapd2010228-e4"/>
Aug 16 12:14:58 user nova-compute[73520]:     </interface>
Aug 16 12:14:58 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:14:58 user nova-compute[73520]:       <mac address="fa:16:3e:32:c5:c8"/>
Aug 16 12:14:58 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:14:58 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:14:58 user nova-compute[73520]:       <target dev="tapee409ffe-08"/>
Aug 16 12:14:58 user nova-compute[73520]:     </interface>
Aug 16 12:14:58 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:14:58 user nova-compute[73520]:       <mac address="fa:16:3e:9b:2e:9e"/>
Aug 16 12:14:58 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:14:58 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:14:58 user nova-compute[73520]:       <target dev="tapd2be9b32-53"/>
Aug 16 12:14:58 user nova-compute[73520]:     </interface>
Aug 16 12:14:58 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:14:58 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/d35ff623-3cb2-420f-98c6-9da333fa5cee/console.log" append="off"/>
Aug 16 12:14:58 user nova-compute[73520]:     </serial>
Aug 16 12:14:58 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:14:58 user nova-compute[73520]:     <video>
Aug 16 12:14:58 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:14:58 user nova-compute[73520]:     </video>
Aug 16 12:14:58 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:14:58 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:14:58 user nova-compute[73520]:     </rng>
Aug 16 12:14:58 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:14:58 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:14:58 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:14:58 user nova-compute[73520]:     </memballoon>
Aug 16 12:14:58 user nova-compute[73520]:   </devices>
Aug 16 12:14:58 user nova-compute[73520]: </domain>
Aug 16 12:14:58 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "address": "fa:16:3e:49:3b:e0", "network": {"id": "742c040c-3528-4df9-9028-88841523fc19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1576139447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17b4d8a-28", "ovs_interfaceid": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "address": "fa:16:3e:49:3b:e0", "network": {"id": "742c040c-3528-4df9-9028-88841523fc19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1576139447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17b4d8a-28", "ovs_interfaceid": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:e0,bridge_name='br-int',has_traffic_filtering=True,id=a17b4d8a-28aa-450d-b11c-6254f52c9cbb,network=Network(742c040c-3528-4df9-9028-88841523fc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17b4d8a-28') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:e0,bridge_name='br-int',has_traffic_filtering=True,id=a17b4d8a-28aa-450d-b11c-6254f52c9cbb,network=Network(742c040c-3528-4df9-9028-88841523fc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17b4d8a-28') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa17b4d8a-28, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa17b4d8a-28, col_values=(('external_ids', {'iface-id': 'a17b4d8a-28aa-450d-b11c-6254f52c9cbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:3b:e0', 'vm-uuid': 'd35ff623-3cb2-420f-98c6-9da333fa5cee'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:58 user nova-compute[73520]: INFO os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:e0,bridge_name='br-int',has_traffic_filtering=True,id=a17b4d8a-28aa-450d-b11c-6254f52c9cbb,network=Network(742c040c-3528-4df9-9028-88841523fc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17b4d8a-28')
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=16cf4ff6-8636-43c0-95c6-8cd845011d8f,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16cf4ff6-86') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=16cf4ff6-8636-43c0-95c6-8cd845011d8f,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16cf4ff6-86') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16cf4ff6-86, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16cf4ff6-86, col_values=(('external_ids', {'iface-id': '16cf4ff6-8636-43c0-95c6-8cd845011d8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:d9:37', 'vm-uuid': 'd35ff623-3cb2-420f-98c6-9da333fa5cee'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:58 user nova-compute[73520]: INFO os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=16cf4ff6-8636-43c0-95c6-8cd845011d8f,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16cf4ff6-86')
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=c775e42a-3c5e-456f-ba77-911c8dc4aa93,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc775e42a-3c') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=c775e42a-3c5e-456f-ba77-911c8dc4aa93,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc775e42a-3c') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.212s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc775e42a-3c, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc775e42a-3c, col_values=(('external_ids', {'iface-id': 'c775e42a-3c5e-456f-ba77-911c8dc4aa93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:16:a5', 'vm-uuid': 'd35ff623-3cb2-420f-98c6-9da333fa5cee'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk 1073741824" returned: 0 in 0.047s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: INFO os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=c775e42a-3c5e-456f-ba77-911c8dc4aa93,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc775e42a-3c')
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "address": "fa:16:3e:5c:b7:6c", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48df8bb9-8a", "ovs_interfaceid": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "address": "fa:16:3e:5c:b7:6c", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48df8bb9-8a", "ovs_interfaceid": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b7:6c,bridge_name='br-int',has_traffic_filtering=True,id=48df8bb9-8a61-49bd-b0b0-7a4b56b87660,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48df8bb9-8a') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b7:6c,bridge_name='br-int',has_traffic_filtering=True,id=48df8bb9-8a61-49bd-b0b0-7a4b56b87660,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48df8bb9-8a') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48df8bb9-8a, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48df8bb9-8a, col_values=(('external_ids', {'iface-id': '48df8bb9-8a61-49bd-b0b0-7a4b56b87660', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:b7:6c', 'vm-uuid': 'd35ff623-3cb2-420f-98c6-9da333fa5cee'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: INFO os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b7:6c,bridge_name='br-int',has_traffic_filtering=True,id=48df8bb9-8a61-49bd-b0b0-7a4b56b87660,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48df8bb9-8a')
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2010228-e41b-4fe6-b814-cfb931b5107a", "address": "fa:16:3e:ed:da:23", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2010228-e4", "ovs_interfaceid": "d2010228-e41b-4fe6-b814-cfb931b5107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "d2010228-e41b-4fe6-b814-cfb931b5107a", "address": "fa:16:3e:ed:da:23", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2010228-e4", "ovs_interfaceid": "d2010228-e41b-4fe6-b814-cfb931b5107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:da:23,bridge_name='br-int',has_traffic_filtering=True,id=d2010228-e41b-4fe6-b814-cfb931b5107a,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2010228-e4') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:da:23,bridge_name='br-int',has_traffic_filtering=True,id=d2010228-e41b-4fe6-b814-cfb931b5107a,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2010228-e4') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2010228-e4, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2010228-e4, col_values=(('external_ids', {'iface-id': 'd2010228-e41b-4fe6-b814-cfb931b5107a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:da:23', 'vm-uuid': 'd35ff623-3cb2-420f-98c6-9da333fa5cee'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-a9bd8d0e-2500-4a39-91bc-a077ecea6fbf req-e253b9f0-60c6-46cd-ba3b-4c9bda5cdfa1 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Received event network-changed-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-a9bd8d0e-2500-4a39-91bc-a077ecea6fbf req-e253b9f0-60c6-46cd-ba3b-4c9bda5cdfa1 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Refreshing instance network info cache due to event network-changed-d1674c7c-7ec6-4ec5-b898-2afd3fcad071. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a9bd8d0e-2500-4a39-91bc-a077ecea6fbf req-e253b9f0-60c6-46cd-ba3b-4c9bda5cdfa1 service nova] Acquiring lock "refresh_cache-4ace588c-2910-477d-a2f1-259bea336e38" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a9bd8d0e-2500-4a39-91bc-a077ecea6fbf req-e253b9f0-60c6-46cd-ba3b-4c9bda5cdfa1 service nova] Acquired lock "refresh_cache-4ace588c-2910-477d-a2f1-259bea336e38" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.network.neutron [req-a9bd8d0e-2500-4a39-91bc-a077ecea6fbf req-e253b9f0-60c6-46cd-ba3b-4c9bda5cdfa1 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Refreshing network info cache for port d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: INFO os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:da:23,bridge_name='br-int',has_traffic_filtering=True,id=d2010228-e41b-4fe6-b814-cfb931b5107a,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2010228-e4')
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=ee409ffe-08fa-490f-ab00-0c107a83ad39,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee409ffe-08') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=ee409ffe-08fa-490f-ab00-0c107a83ad39,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee409ffe-08') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee409ffe-08, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee409ffe-08, col_values=(('external_ids', {'iface-id': 'ee409ffe-08fa-490f-ab00-0c107a83ad39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:c5:c8', 'vm-uuid': 'd35ff623-3cb2-420f-98c6-9da333fa5cee'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.203s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: INFO os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=ee409ffe-08fa-490f-ab00-0c107a83ad39,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee409ffe-08')
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d2be9b32-5339-4e58-abd1-02cf8c09b9e2,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9b32-53') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d2be9b32-5339-4e58-abd1-02cf8c09b9e2,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9b32-53') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2be9b32-53, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2be9b32-53, col_values=(('external_ids', {'iface-id': 'd2be9b32-5339-4e58-abd1-02cf8c09b9e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:2e:9e', 'vm-uuid': 'd35ff623-3cb2-420f-98c6-9da333fa5cee'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:14:59 user nova-compute[73520]: INFO os_vif [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d2be9b32-5339-4e58-abd1-02cf8c09b9e2,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9b32-53')
Aug 16 12:14:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Cannot resize image /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.objects.instance [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'migration_context' on Instance uuid 6ea9ce4f-479a-42c5-8610-1d1edd06e199 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Ensure instance console log exists: /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] No BDM found with device name hda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] No VIF found with MAC fa:16:3e:49:3b:e0, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] No VIF found with MAC fa:16:3e:ed:da:23, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:14:59 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Using config drive
Aug 16 12:14:59 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Successfully created port: b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:14:59 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Creating config drive at /opt/stack/data/nova/instances/d35ff623-3cb2-420f-98c6-9da333fa5cee/disk.config
Aug 16 12:14:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d35ff623-3cb2-420f-98c6-9da333fa5cee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpv5uj359j {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:14:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d35ff623-3cb2-420f-98c6-9da333fa5cee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpv5uj359j" returned: 0 in 0.067s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:00 user nova-compute[73520]: DEBUG nova.network.neutron [req-a9bd8d0e-2500-4a39-91bc-a077ecea6fbf req-e253b9f0-60c6-46cd-ba3b-4c9bda5cdfa1 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Updated VIF entry in instance network info cache for port d1674c7c-7ec6-4ec5-b898-2afd3fcad071. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:15:00 user nova-compute[73520]: DEBUG nova.network.neutron [req-a9bd8d0e-2500-4a39-91bc-a077ecea6fbf req-e253b9f0-60c6-46cd-ba3b-4c9bda5cdfa1 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Updating instance_info_cache with network_info: [{"id": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "address": "fa:16:3e:e8:1c:7e", "network": {"id": "a9472174-9ce5-4cb7-a698-35f03a009863", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-924117371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63ee7d988f4c40a4233d32238331d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1674c7c-7e", "ovs_interfaceid": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:15:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a9bd8d0e-2500-4a39-91bc-a077ecea6fbf req-e253b9f0-60c6-46cd-ba3b-4c9bda5cdfa1 service nova] Releasing lock "refresh_cache-4ace588c-2910-477d-a2f1-259bea336e38" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:15:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-a4a69a64-4502-457b-b200-cf14d6e3181f req-0cad9f8c-a785-43ab-b361-4a83d94f4176 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received event network-changed-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-a4a69a64-4502-457b-b200-cf14d6e3181f req-0cad9f8c-a785-43ab-b361-4a83d94f4176 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Refreshing instance network info cache due to event network-changed-2afb34f7-7b7d-443d-981f-6ef40dd67a0c. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:15:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a4a69a64-4502-457b-b200-cf14d6e3181f req-0cad9f8c-a785-43ab-b361-4a83d94f4176 service nova] Acquiring lock "refresh_cache-4ce719c9-0210-414f-bbf3-37bfa392125c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:15:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a4a69a64-4502-457b-b200-cf14d6e3181f req-0cad9f8c-a785-43ab-b361-4a83d94f4176 service nova] Acquired lock "refresh_cache-4ce719c9-0210-414f-bbf3-37bfa392125c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:15:00 user nova-compute[73520]: DEBUG nova.network.neutron [req-a4a69a64-4502-457b-b200-cf14d6e3181f req-0cad9f8c-a785-43ab-b361-4a83d94f4176 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Refreshing network info cache for port 2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:15:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:00 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lazy-loading 'flavor' on Instance uuid 4ce719c9-0210-414f-bbf3-37bfa392125c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.130s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Successfully updated port: b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:01 user nova-compute[73520]: INFO nova.compute.manager [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Attaching volume b0759104-8aa8-479a-9860-378abe4372a8 to /dev/vdb
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "refresh_cache-6ea9ce4f-479a-42c5-8610-1d1edd06e199" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquired lock "refresh_cache-6ea9ce4f-479a-42c5-8610-1d1edd06e199" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG nova.compute.manager [req-8ad99406-782d-49f7-92e3-89cfbb4dd116 req-7cd2312d-771b-48ec-adff-7f5050b64335 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Received event network-changed-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG nova.compute.manager [req-8ad99406-782d-49f7-92e3-89cfbb4dd116 req-7cd2312d-771b-48ec-adff-7f5050b64335 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Refreshing instance network info cache due to event network-changed-b9b63116-58c8-40ee-81cd-cf03d0f2ec88. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8ad99406-782d-49f7-92e3-89cfbb4dd116 req-7cd2312d-771b-48ec-adff-7f5050b64335 service nova] Acquiring lock "refresh_cache-6ea9ce4f-479a-42c5-8610-1d1edd06e199" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG nova.compute.manager [req-6bc1b600-eb01-4b79-a7ba-a8d45a282541 req-1ae3b296-bfc1-4b2a-a94e-f1d1c22f9021 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Received event network-changed-4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG nova.compute.manager [req-6bc1b600-eb01-4b79-a7ba-a8d45a282541 req-1ae3b296-bfc1-4b2a-a94e-f1d1c22f9021 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Refreshing instance network info cache due to event network-changed-4512d351-5628-4309-990f-dff795735e3c. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6bc1b600-eb01-4b79-a7ba-a8d45a282541 req-1ae3b296-bfc1-4b2a-a94e-f1d1c22f9021 service nova] Acquiring lock "refresh_cache-c1492de2-3545-4ef7-bf3d-07e779d73f8d" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6bc1b600-eb01-4b79-a7ba-a8d45a282541 req-1ae3b296-bfc1-4b2a-a94e-f1d1c22f9021 service nova] Acquired lock "refresh_cache-c1492de2-3545-4ef7-bf3d-07e779d73f8d" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG nova.network.neutron [req-6bc1b600-eb01-4b79-a7ba-a8d45a282541 req-1ae3b296-bfc1-4b2a-a94e-f1d1c22f9021 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Refreshing network info cache for port 4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG os_brick.utils [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac682a0-03af-43f5-aedc-9beda1a9ed3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[199416c7-adb2-4174-95b5-4192639c13a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f442095-109a-4eff-ace5-ba67726bf010]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b576a3a-8f3f-408c-8333-6ac06ce83141]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:15:01 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af57ad0-35de-4427-b009-25b9a87aca5c]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG os_brick.utils [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Updating existing volume attachment record: a89afd97-cbd2-4993-ac28-bceb278b4546 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG nova.network.neutron [req-a4a69a64-4502-457b-b200-cf14d6e3181f req-0cad9f8c-a785-43ab-b361-4a83d94f4176 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Updated VIF entry in instance network info cache for port 2afb34f7-7b7d-443d-981f-6ef40dd67a0c. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG nova.network.neutron [req-a4a69a64-4502-457b-b200-cf14d6e3181f req-0cad9f8c-a785-43ab-b361-4a83d94f4176 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Updating instance_info_cache with network_info: [{"id": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "address": "fa:16:3e:1d:41:db", "network": {"id": "ec26c36e-9fe5-4056-8714-2fbb92d9b4cc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-795728958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caab51add8e64f9686ad8f216d138814", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afb34f7-7b", "ovs_interfaceid": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a4a69a64-4502-457b-b200-cf14d6e3181f req-0cad9f8c-a785-43ab-b361-4a83d94f4176 service nova] Releasing lock "refresh_cache-4ce719c9-0210-414f-bbf3-37bfa392125c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.compute.manager [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.compute.manager [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:02 user nova-compute[73520]: WARNING nova.compute.manager [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-a17b4d8a-28aa-450d-b11c-6254f52c9cbb for instance with vm_state building and task_state spawning.
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.compute.manager [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.compute.manager [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:02 user nova-compute[73520]: WARNING nova.compute.manager [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-a17b4d8a-28aa-450d-b11c-6254f52c9cbb for instance with vm_state building and task_state spawning.
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.compute.manager [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.compute.manager [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:02 user nova-compute[73520]: WARNING nova.compute.manager [req-1f1f3350-9064-4205-aacc-b7b6602fb75a req-5fb9a1d5-c809-40a2-a519-ed0a729685b9 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 for instance with vm_state building and task_state spawning.
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Updating instance_info_cache with network_info: [{"id": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "address": "fa:16:3e:07:c9:d0", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b63116-58", "ovs_interfaceid": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Releasing lock "refresh_cache-6ea9ce4f-479a-42c5-8610-1d1edd06e199" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Instance network_info: |[{"id": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "address": "fa:16:3e:07:c9:d0", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b63116-58", "ovs_interfaceid": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8ad99406-782d-49f7-92e3-89cfbb4dd116 req-7cd2312d-771b-48ec-adff-7f5050b64335 service nova] Acquired lock "refresh_cache-6ea9ce4f-479a-42c5-8610-1d1edd06e199" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.network.neutron [req-8ad99406-782d-49f7-92e3-89cfbb4dd116 req-7cd2312d-771b-48ec-adff-7f5050b64335 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Refreshing network info cache for port b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Start _get_guest_xml network_info=[{"id": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "address": "fa:16:3e:07:c9:d0", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b63116-58", "ovs_interfaceid": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.network.neutron [req-6bc1b600-eb01-4b79-a7ba-a8d45a282541 req-1ae3b296-bfc1-4b2a-a94e-f1d1c22f9021 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Updated VIF entry in instance network info cache for port 4512d351-5628-4309-990f-dff795735e3c. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.network.neutron [req-6bc1b600-eb01-4b79-a7ba-a8d45a282541 req-1ae3b296-bfc1-4b2a-a94e-f1d1c22f9021 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Updating instance_info_cache with network_info: [{"id": "4512d351-5628-4309-990f-dff795735e3c", "address": "fa:16:3e:4b:49:90", "network": {"id": "7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-954407765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c922281e6ebc4d9a94b2f4bed5de8c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4512d351-56", "ovs_interfaceid": "4512d351-5628-4309-990f-dff795735e3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:15:02 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:15:02 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6bc1b600-eb01-4b79-a7ba-a8d45a282541 req-1ae3b296-bfc1-4b2a-a94e-f1d1c22f9021 service nova] Releasing lock "refresh_cache-c1492de2-3545-4ef7-bf3d-07e779d73f8d" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-482985637',display_name='tempest-AttachVolumeNegativeTest-server-482985637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-482985637',id=13,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjAz5eFoacIb5n427h8AghyOoy4cW2jn/qT+ECphwo5zcoxilDcnQRN7rBOaco0lfRlWonvZ6vKXZ3bjKvZTRZGAXym8bA1Q9WB3L7UhZtPJ7UISnXifJtg5Z+41S2a5w==',key_name='tempest-keypair-1148098543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1059841e2ee04ca4870497a1ec60bcaa',ramdisk_id='',reservation_id='r-xq2chp7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1618912538',owner_user_name='tempest-AttachVolumeNegativeTest-1618912538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:14:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6426c917725745038fdb1d03fec4a2fd',uuid=6ea9ce4f-479a-42c5-8610-1d1edd06e199,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "address": "fa:16:3e:07:c9:d0", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b63116-58", "ovs_interfaceid": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converting VIF {"id": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "address": "fa:16:3e:07:c9:d0", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b63116-58", "ovs_interfaceid": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=b9b63116-58c8-40ee-81cd-cf03d0f2ec88,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b63116-58') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.objects.instance [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ea9ce4f-479a-42c5-8610-1d1edd06e199 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:15:02 user nova-compute[73520]:   <uuid>6ea9ce4f-479a-42c5-8610-1d1edd06e199</uuid>
Aug 16 12:15:02 user nova-compute[73520]:   <name>instance-0000000d</name>
Aug 16 12:15:02 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:15:02 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:15:02 user nova-compute[73520]:   <metadata>
Aug 16 12:15:02 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:15:02 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:15:02 user nova-compute[73520]:       <nova:name>tempest-AttachVolumeNegativeTest-server-482985637</nova:name>
Aug 16 12:15:02 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:15:02</nova:creationTime>
Aug 16 12:15:02 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:15:02 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:15:02 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:15:02 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:15:02 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:15:02 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:15:02 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:15:02 user nova-compute[73520]:       <nova:owner>
Aug 16 12:15:02 user nova-compute[73520]:         <nova:user uuid="6426c917725745038fdb1d03fec4a2fd">tempest-AttachVolumeNegativeTest-1618912538-project-member</nova:user>
Aug 16 12:15:02 user nova-compute[73520]:         <nova:project uuid="1059841e2ee04ca4870497a1ec60bcaa">tempest-AttachVolumeNegativeTest-1618912538</nova:project>
Aug 16 12:15:02 user nova-compute[73520]:       </nova:owner>
Aug 16 12:15:02 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:15:02 user nova-compute[73520]:       <nova:ports>
Aug 16 12:15:02 user nova-compute[73520]:         <nova:port uuid="b9b63116-58c8-40ee-81cd-cf03d0f2ec88">
Aug 16 12:15:02 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 12:15:02 user nova-compute[73520]:         </nova:port>
Aug 16 12:15:02 user nova-compute[73520]:       </nova:ports>
Aug 16 12:15:02 user nova-compute[73520]:     </nova:instance>
Aug 16 12:15:02 user nova-compute[73520]:   </metadata>
Aug 16 12:15:02 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:15:02 user nova-compute[73520]:     <system>
Aug 16 12:15:02 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:15:02 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:15:02 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:15:02 user nova-compute[73520]:       <entry name="serial">6ea9ce4f-479a-42c5-8610-1d1edd06e199</entry>
Aug 16 12:15:02 user nova-compute[73520]:       <entry name="uuid">6ea9ce4f-479a-42c5-8610-1d1edd06e199</entry>
Aug 16 12:15:02 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:15:02 user nova-compute[73520]:     </system>
Aug 16 12:15:02 user nova-compute[73520]:   </sysinfo>
Aug 16 12:15:02 user nova-compute[73520]:   <os>
Aug 16 12:15:02 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:15:02 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:15:02 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:15:02 user nova-compute[73520]:   </os>
Aug 16 12:15:02 user nova-compute[73520]:   <features>
Aug 16 12:15:02 user nova-compute[73520]:     <acpi/>
Aug 16 12:15:02 user nova-compute[73520]:     <apic/>
Aug 16 12:15:02 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:15:02 user nova-compute[73520]:   </features>
Aug 16 12:15:02 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:15:02 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:15:02 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:15:02 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:15:02 user nova-compute[73520]:   </clock>
Aug 16 12:15:02 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:15:02 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:15:02 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:15:02 user nova-compute[73520]:   </cpu>
Aug 16 12:15:02 user nova-compute[73520]:   <devices>
Aug 16 12:15:02 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:15:02 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:15:02 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk"/>
Aug 16 12:15:02 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:15:02 user nova-compute[73520]:     </disk>
Aug 16 12:15:02 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:15:02 user nova-compute[73520]:       <mac address="fa:16:3e:07:c9:d0"/>
Aug 16 12:15:02 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:15:02 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:15:02 user nova-compute[73520]:       <target dev="tapb9b63116-58"/>
Aug 16 12:15:02 user nova-compute[73520]:     </interface>
Aug 16 12:15:02 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:15:02 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/console.log" append="off"/>
Aug 16 12:15:02 user nova-compute[73520]:     </serial>
Aug 16 12:15:02 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:15:02 user nova-compute[73520]:     <video>
Aug 16 12:15:02 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:15:02 user nova-compute[73520]:     </video>
Aug 16 12:15:02 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:15:02 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:15:02 user nova-compute[73520]:     </rng>
Aug 16 12:15:02 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:15:02 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:15:02 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:15:02 user nova-compute[73520]:     </memballoon>
Aug 16 12:15:02 user nova-compute[73520]:   </devices>
Aug 16 12:15:02 user nova-compute[73520]: </domain>
Aug 16 12:15:02 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-482985637',display_name='tempest-AttachVolumeNegativeTest-server-482985637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-482985637',id=13,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjAz5eFoacIb5n427h8AghyOoy4cW2jn/qT+ECphwo5zcoxilDcnQRN7rBOaco0lfRlWonvZ6vKXZ3bjKvZTRZGAXym8bA1Q9WB3L7UhZtPJ7UISnXifJtg5Z+41S2a5w==',key_name='tempest-keypair-1148098543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1059841e2ee04ca4870497a1ec60bcaa',ramdisk_id='',reservation_id='r-xq2chp7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1618912538',owner_user_name='tempest-AttachVolumeNegativeTest-1618912538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:14:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6426c917725745038fdb1d03fec4a2fd',uuid=6ea9ce4f-479a-42c5-8610-1d1edd06e199,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "address": "fa:16:3e:07:c9:d0", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b63116-58", "ovs_interfaceid": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converting VIF {"id": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "address": "fa:16:3e:07:c9:d0", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b63116-58", "ovs_interfaceid": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=b9b63116-58c8-40ee-81cd-cf03d0f2ec88,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b63116-58') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG os_vif [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=b9b63116-58c8-40ee-81cd-cf03d0f2ec88,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b63116-58') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9b63116-58, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9b63116-58, col_values=(('external_ids', {'iface-id': 'b9b63116-58c8-40ee-81cd-cf03d0f2ec88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:c9:d0', 'vm-uuid': '6ea9ce4f-479a-42c5-8610-1d1edd06e199'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:03 user nova-compute[73520]: INFO os_vif [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=b9b63116-58c8-40ee-81cd-cf03d0f2ec88,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b63116-58')
Aug 16 12:15:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No VIF found with MAC fa:16:3e:07:c9:d0, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-5231e5b2-1cf2-4742-a713-80410915f9c5 req-3b10ddd3-81b2-40ad-8af5-ca13c68840dc service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-16cf4ff6-8636-43c0-95c6-8cd845011d8f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5231e5b2-1cf2-4742-a713-80410915f9c5 req-3b10ddd3-81b2-40ad-8af5-ca13c68840dc service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5231e5b2-1cf2-4742-a713-80410915f9c5 req-3b10ddd3-81b2-40ad-8af5-ca13c68840dc service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5231e5b2-1cf2-4742-a713-80410915f9c5 req-3b10ddd3-81b2-40ad-8af5-ca13c68840dc service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-5231e5b2-1cf2-4742-a713-80410915f9c5 req-3b10ddd3-81b2-40ad-8af5-ca13c68840dc service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-16cf4ff6-8636-43c0-95c6-8cd845011d8f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:03 user nova-compute[73520]: WARNING nova.compute.manager [req-5231e5b2-1cf2-4742-a713-80410915f9c5 req-3b10ddd3-81b2-40ad-8af5-ca13c68840dc service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-16cf4ff6-8636-43c0-95c6-8cd845011d8f for instance with vm_state building and task_state spawning.
Aug 16 12:15:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-5231e5b2-1cf2-4742-a713-80410915f9c5 req-3b10ddd3-81b2-40ad-8af5-ca13c68840dc service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-16cf4ff6-8636-43c0-95c6-8cd845011d8f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5231e5b2-1cf2-4742-a713-80410915f9c5 req-3b10ddd3-81b2-40ad-8af5-ca13c68840dc service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5231e5b2-1cf2-4742-a713-80410915f9c5 req-3b10ddd3-81b2-40ad-8af5-ca13c68840dc service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5231e5b2-1cf2-4742-a713-80410915f9c5 req-3b10ddd3-81b2-40ad-8af5-ca13c68840dc service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-5231e5b2-1cf2-4742-a713-80410915f9c5 req-3b10ddd3-81b2-40ad-8af5-ca13c68840dc service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-16cf4ff6-8636-43c0-95c6-8cd845011d8f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:03 user nova-compute[73520]: WARNING nova.compute.manager [req-5231e5b2-1cf2-4742-a713-80410915f9c5 req-3b10ddd3-81b2-40ad-8af5-ca13c68840dc service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-16cf4ff6-8636-43c0-95c6-8cd845011d8f for instance with vm_state building and task_state spawning.
Aug 16 12:15:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-20c1f121-9f8b-4333-8ded-a948436645e0 req-d4f3e4d5-f362-44b5-90d4-769ae1df7b24 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-c775e42a-3c5e-456f-ba77-911c8dc4aa93 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20c1f121-9f8b-4333-8ded-a948436645e0 req-d4f3e4d5-f362-44b5-90d4-769ae1df7b24 service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20c1f121-9f8b-4333-8ded-a948436645e0 req-d4f3e4d5-f362-44b5-90d4-769ae1df7b24 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20c1f121-9f8b-4333-8ded-a948436645e0 req-d4f3e4d5-f362-44b5-90d4-769ae1df7b24 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-20c1f121-9f8b-4333-8ded-a948436645e0 req-d4f3e4d5-f362-44b5-90d4-769ae1df7b24 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-c775e42a-3c5e-456f-ba77-911c8dc4aa93 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:03 user nova-compute[73520]: WARNING nova.compute.manager [req-20c1f121-9f8b-4333-8ded-a948436645e0 req-d4f3e4d5-f362-44b5-90d4-769ae1df7b24 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-c775e42a-3c5e-456f-ba77-911c8dc4aa93 for instance with vm_state building and task_state spawning.
Aug 16 12:15:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-20c1f121-9f8b-4333-8ded-a948436645e0 req-d4f3e4d5-f362-44b5-90d4-769ae1df7b24 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-c775e42a-3c5e-456f-ba77-911c8dc4aa93 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20c1f121-9f8b-4333-8ded-a948436645e0 req-d4f3e4d5-f362-44b5-90d4-769ae1df7b24 service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20c1f121-9f8b-4333-8ded-a948436645e0 req-d4f3e4d5-f362-44b5-90d4-769ae1df7b24 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20c1f121-9f8b-4333-8ded-a948436645e0 req-d4f3e4d5-f362-44b5-90d4-769ae1df7b24 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-20c1f121-9f8b-4333-8ded-a948436645e0 req-d4f3e4d5-f362-44b5-90d4-769ae1df7b24 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-c775e42a-3c5e-456f-ba77-911c8dc4aa93 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:03 user nova-compute[73520]: WARNING nova.compute.manager [req-20c1f121-9f8b-4333-8ded-a948436645e0 req-d4f3e4d5-f362-44b5-90d4-769ae1df7b24 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-c775e42a-3c5e-456f-ba77-911c8dc4aa93 for instance with vm_state building and task_state spawning.
Aug 16 12:15:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG nova.network.neutron [req-8ad99406-782d-49f7-92e3-89cfbb4dd116 req-7cd2312d-771b-48ec-adff-7f5050b64335 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Updated VIF entry in instance network info cache for port b9b63116-58c8-40ee-81cd-cf03d0f2ec88. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG nova.network.neutron [req-8ad99406-782d-49f7-92e3-89cfbb4dd116 req-7cd2312d-771b-48ec-adff-7f5050b64335 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Updating instance_info_cache with network_info: [{"id": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "address": "fa:16:3e:07:c9:d0", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b63116-58", "ovs_interfaceid": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8ad99406-782d-49f7-92e3-89cfbb4dd116 req-7cd2312d-771b-48ec-adff-7f5050b64335 service nova] Releasing lock "refresh_cache-6ea9ce4f-479a-42c5-8610-1d1edd06e199" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG nova.objects.instance [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lazy-loading 'flavor' on Instance uuid c1492de2-3545-4ef7-bf3d-07e779d73f8d {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "4ace588c-2910-477d-a2f1-259bea336e38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "4ace588c-2910-477d-a2f1-259bea336e38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:15:04 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Creating image(s)
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Ensure instance console log exists: /opt/stack/data/nova/instances/ff7477c9-0c43-4aff-a7c3-e9311c965f40/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Start _get_guest_xml network_info=[{"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "address": "fa:16:3e:4a:d3:74", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43824ad0-ef", "ovs_interfaceid": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "address": "fa:16:3e:d7:8c:a9", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60f87c0-2d", "ovs_interfaceid": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTWCPGic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff7477c9-0c43-4aff-a7c3-e9311c965f40', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0318da1-09d3-4916-a9fb-8168456b93ad', 'serial': 'd0318da1-09d3-4916-a9fb-8168456b93ad'}, 'attachment_id': '4d93f4a5-b40d-4176-88fe-562163887123', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCJNnjYP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff7477c9-0c43-4aff-a7c3-e9311c965f40', 'attached_at': '', 'detached_at': '', 'volume_id': '5480195e-373a-4385-af13-1c5c8401ded9', 'serial': '5480195e-373a-4385-af13-1c5c8401ded9'}, 'attachment_id': '3b73a01f-5067-400d-815d-79cebabc547a', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swuZPcDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff7477c9-0c43-4aff-a7c3-e9311c965f40', 'attached_at': '', 'detached_at': '', 'volume_id': '1ca61a09-f1a6-438d-b4ef-2ca571993add', 'serial': '1ca61a09-f1a6-438d-b4ef-2ca571993add'}, 'attachment_id': 'd407fc1c-4694-48d1-a17b-29714e239bcd', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.objects.instance [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lazy-loading 'flavor' on Instance uuid 4ace588c-2910-477d-a2f1-259bea336e38 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:04 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:15:04 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTWCPGic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:04 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:04 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:04 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f3212b-3cfb-4629-b0da-38feaec7d069]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:04 user nova-compute[73520]: INFO nova.compute.manager [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Attaching volume f43ce2ed-f531-4871-ba93-cbfdb6101e9d to /dev/vdb
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:15:04 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "4ace588c-2910-477d-a2f1-259bea336e38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.206s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe6af46-5f89-4342-a47d-2880afdf6564]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad] added
Aug 16 12:15:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[915c93d5-d353-4ea7-9519-4572118b3feb]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.utils [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2ee799-53f2-499c-970f-7412c9563673]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTWCPGic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ef246c-5d11-4da2-835e-2a394f5be6bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTWCPGic" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a8a611-63f2-424f-a458-831f301db3e2]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sTWCPGic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[471b550e-d8c3-4c73-a440-8c06da75ac66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1c1aa7-70c8-4ee0-9a6c-74369b4038af]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f613aff3-a19e-439d-98f1-0eac3984e663]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f03073f-e7f7-4dd2-b494-40449747c2e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ad8e00-cd03-4bfa-abf5-04869563a9e7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:15:04 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e427eb-6e1b-46ea-a4c9-c75eeba0b8db]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.utils [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Updating existing volume attachment record: 15cf1dea-b2ec-414f-acb1-6a3dc36dec71 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "4ace588c-2910-477d-a2f1-259bea336e38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "4ace588c-2910-477d-a2f1-259bea336e38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:04 user nova-compute[73520]: INFO nova.compute.manager [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Attaching volume a5e30949-a1cb-46fb-ada6-7a886eba6525 to /dev/sdc
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[617ff574-a468-4d9a-bd89-228272e0d6bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad, portal: 172.16.0.220,3260]
Aug 16 12:15:04 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad, portal: 172.16.0.220,3260] successful.
Aug 16 12:15:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eba722-c203-4bba-a09d-b8dfe8977a37]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa28626f-ab54-4cfe-a57a-5c6adb2d101d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:04 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:04 user nova-compute[73520]: WARNING nova.compute.manager [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 for instance with vm_state building and task_state spawning.
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:04 user nova-compute[73520]: WARNING nova.compute.manager [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 for instance with vm_state building and task_state spawning.
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:04 user nova-compute[73520]: WARNING nova.compute.manager [req-e0936941-6c71-4846-acc1-b59a6592294f req-28244543-b761-4dc3-a9a7-2d804b27488e service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 for instance with vm_state building and task_state spawning.
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5760b126-ee18-4530-a6f4-f93aab89be1e]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTWCPGic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-d2010228-e41b-4fe6-b814-cfb931b5107a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-d2010228-e41b-4fe6-b814-cfb931b5107a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:05 user nova-compute[73520]: WARNING nova.compute.manager [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-d2010228-e41b-4fe6-b814-cfb931b5107a for instance with vm_state building and task_state spawning.
Aug 16 12:15:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-d2010228-e41b-4fe6-b814-cfb931b5107a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-d2010228-e41b-4fe6-b814-cfb931b5107a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:05 user nova-compute[73520]: WARNING nova.compute.manager [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-d2010228-e41b-4fe6-b814-cfb931b5107a for instance with vm_state building and task_state spawning.
Aug 16 12:15:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-ee409ffe-08fa-490f-ab00-0c107a83ad39 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-ee409ffe-08fa-490f-ab00-0c107a83ad39 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:05 user nova-compute[73520]: WARNING nova.compute.manager [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-ee409ffe-08fa-490f-ab00-0c107a83ad39 for instance with vm_state building and task_state spawning.
Aug 16 12:15:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-ee409ffe-08fa-490f-ab00-0c107a83ad39 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-ee409ffe-08fa-490f-ab00-0c107a83ad39 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:05 user nova-compute[73520]: WARNING nova.compute.manager [req-df841e61-78fe-4832-82bd-09cdb21e41c5 req-79d5b97c-8856-47e1-8ba7-13d779fb94ce service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-ee409ffe-08fa-490f-ab00-0c107a83ad39 for instance with vm_state building and task_state spawning.
Aug 16 12:15:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-f7aaab99-54aa-4fb7-8cd3-a054d62469a4 req-6b194c83-cf39-4bb6-9268-f181baa7b91a service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Received event network-vif-plugged-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f7aaab99-54aa-4fb7-8cd3-a054d62469a4 req-6b194c83-cf39-4bb6-9268-f181baa7b91a service nova] Acquiring lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f7aaab99-54aa-4fb7-8cd3-a054d62469a4 req-6b194c83-cf39-4bb6-9268-f181baa7b91a service nova] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f7aaab99-54aa-4fb7-8cd3-a054d62469a4 req-6b194c83-cf39-4bb6-9268-f181baa7b91a service nova] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-f7aaab99-54aa-4fb7-8cd3-a054d62469a4 req-6b194c83-cf39-4bb6-9268-f181baa7b91a service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] No waiting events found dispatching network-vif-plugged-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:05 user nova-compute[73520]: WARNING nova.compute.manager [req-f7aaab99-54aa-4fb7-8cd3-a054d62469a4 req-6b194c83-cf39-4bb6-9268-f181baa7b91a service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Received unexpected event network-vif-plugged-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 for instance with vm_state building and task_state spawning.
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '23535336331623032', 'path': '/dev/sdg'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535336331623032', 'path': '/dev/sdg'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCJNnjYP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:05 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:05 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:05 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d656947-0203-415b-9d6f-1932835be18b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:15:05 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b8344c-ca63-4f87-b777-cff7b4ccc890]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9] added
Aug 16 12:15:05 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a49120-4bfd-4be3-acfc-16b469d4975d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0560589b-e461-4936-92e6-afee547bf39c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCJNnjYP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCJNnjYP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf452e3-49e4-410b-a80e-b33d54980996]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XCJNnjYP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[705598af-0cd8-4ea7-8ca7-6609454fcac2]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61c50d7-47c0-4d58-a0f3-68d759b2427c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:05 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:05 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:05 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:05 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:05 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:05 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:05 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:05 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:05 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:05 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:05 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:05 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --login" returned: 0 in 0.119s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[11024cd2-bc27-44d8-b620-eab1dfbf79aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9, portal: 172.16.0.220,3260]
Aug 16 12:15:05 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9, portal: 172.16.0.220,3260] successful.
Aug 16 12:15:05 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52b2fce-d2bf-40f0-b5ac-4848b472128e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc3c0e9-cc30-455c-b91f-15453ad5e1b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:06 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:06 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:06 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:06 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:06 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:06 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:06 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:06 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:06 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:06 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:06 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:06 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:06 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:06 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aba7d0-2846-4181-a9c9-67dd236be124]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCJNnjYP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188106.904861, d35ff623-3cb2-420f-98c6-9da333fa5cee => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:15:06 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] VM Resumed (Lifecycle Event)
Aug 16 12:15:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:15:06 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Instance spawned successfully.
Aug 16 12:15:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:07 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188106.9108303, d35ff623-3cb2-420f-98c6-9da333fa5cee => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:15:07 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] VM Started (Lifecycle Event)
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:15:07 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:15:07 user nova-compute[73520]: INFO nova.compute.manager [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Took 12.98 seconds to spawn the instance on the hypervisor.
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23130316564323031', 'path': '/dev/sdh'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130316564323031', 'path': '/dev/sdh'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swuZPcDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:07 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:07 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:07 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[58131fb6-1ef4-4c06-9549-ac1e6d31bfe1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:15:07 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6643dcae-6412-4818-ac48-0329113dbe5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add] added
Aug 16 12:15:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:07 user nova-compute[73520]: INFO nova.compute.manager [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Took 69.98 seconds to build instance.
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-62da9ae7-b0d8-453c-b0f3-ef49891187d5 tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 70.077s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33224f4-3195-44df-9207-114907f13114]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f1c9de-6981-47a6-9588-7b56dcbefbd0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op update -n node.session.auth.username -v swuZPcDQ {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op update -n node.session.auth.username -v swuZPcDQ" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb55baa-1242-4155-9944-f2ce491df566]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'swuZPcDQ'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[885ef5a6-41b4-4405-9c6d-79019829a556]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[301b312c-74d6-41d3-956b-502a0346e01a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188107.3784642, 6ea9ce4f-479a-42c5-8610-1d1edd06e199 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:15:07 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] VM Resumed (Lifecycle Event)
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:15:07 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Instance spawned successfully.
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2727a267-10c7-4635-8dca-df3a0c1340cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add, portal: 172.16.0.220,3260]
Aug 16 12:15:07 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add, portal: 172.16.0.220,3260] successful.
Aug 16 12:15:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[064936a6-8abd-4fa4-a12f-b75b66f8266c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:07 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188107.38041, 6ea9ce4f-479a-42c5-8610-1d1edd06e199 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:15:07 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] VM Started (Lifecycle Event)
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[218cf35b-c820-4d70-ae9d-ead8adfb7f69]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:07 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4055eb6-3185-409d-9925-66f748375b90]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:07 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swuZPcDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:15:07 user nova-compute[73520]: INFO nova.compute.manager [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Took 9.02 seconds to spawn the instance on the hypervisor.
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-ab0991bb-4f1b-44e2-8fc5-a3b1392084f0 req-f8b55c7c-be04-49cc-80f2-9e9a592346ec service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Received event network-vif-plugged-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ab0991bb-4f1b-44e2-8fc5-a3b1392084f0 req-f8b55c7c-be04-49cc-80f2-9e9a592346ec service nova] Acquiring lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ab0991bb-4f1b-44e2-8fc5-a3b1392084f0 req-f8b55c7c-be04-49cc-80f2-9e9a592346ec service nova] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ab0991bb-4f1b-44e2-8fc5-a3b1392084f0 req-f8b55c7c-be04-49cc-80f2-9e9a592346ec service nova] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-ab0991bb-4f1b-44e2-8fc5-a3b1392084f0 req-f8b55c7c-be04-49cc-80f2-9e9a592346ec service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] No waiting events found dispatching network-vif-plugged-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:07 user nova-compute[73520]: WARNING nova.compute.manager [req-ab0991bb-4f1b-44e2-8fc5-a3b1392084f0 req-f8b55c7c-be04-49cc-80f2-9e9a592346ec service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Received unexpected event network-vif-plugged-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 for instance with vm_state active and task_state None.
Aug 16 12:15:07 user nova-compute[73520]: INFO nova.compute.manager [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Took 10.33 seconds to build instance.
Aug 16 12:15:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f9518cd-227c-4adb-b0f0-081be82bfad7 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.429s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26531376132626265', 'path': '/dev/sdi'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531376132626265', 'path': '/dev/sdi'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:15:46,bridge_name='br-int',has_traffic_filtering=True,id=ae0884bb-d1e5-41f4-82a1-cf1612acc3ef,network=Network(d4cc21ca-5d96-42cb-99ea-e8ac506baf8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0884bb-d1') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=55dedb2f-d7f3-4f2e-bbff-90f53641c5ca,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55dedb2f-d7') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:53:42,bridge_name='br-int',has_traffic_filtering=True,id=a983f522-a453-4636-a051-5780b31b3092,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa983f522-a4') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=e289552d-05b7-418b-97c2-7d13c956b3fa,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape289552d-05') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=2c8f553a-1fb2-4a3b-80dd-0d549112f793,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f553a-1f') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "address": "fa:16:3e:4a:d3:74", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43824ad0-ef", "ovs_interfaceid": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "address": "fa:16:3e:4a:d3:74", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43824ad0-ef", "ovs_interfaceid": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=43824ad0-ef35-4471-9ce5-ffedc9f3784a,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43824ad0-ef') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "address": "fa:16:3e:d7:8c:a9", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60f87c0-2d", "ovs_interfaceid": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "address": "fa:16:3e:d7:8c:a9", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60f87c0-2d", "ovs_interfaceid": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:8c:a9,bridge_name='br-int',has_traffic_filtering=True,id=c60f87c0-2d15-4360-8fa0-bf406fff942d,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60f87c0-2d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.objects.instance [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lazy-loading 'pci_devices' on Instance uuid ff7477c9-0c43-4aff-a7c3-e9311c965f40 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:15:08 user nova-compute[73520]:   <uuid>ff7477c9-0c43-4aff-a7c3-e9311c965f40</uuid>
Aug 16 12:15:08 user nova-compute[73520]:   <name>instance-0000000c</name>
Aug 16 12:15:08 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:15:08 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:15:08 user nova-compute[73520]:   <metadata>
Aug 16 12:15:08 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:15:08 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:15:08 user nova-compute[73520]:       <nova:name>tempest-device-tagging-server-1715656529</nova:name>
Aug 16 12:15:08 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:15:04</nova:creationTime>
Aug 16 12:15:08 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:15:08 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:15:08 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:15:08 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:15:08 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:15:08 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:15:08 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:15:08 user nova-compute[73520]:       <nova:owner>
Aug 16 12:15:08 user nova-compute[73520]:         <nova:user uuid="eb48cfae9bca41bbac0fff658bf6cdbc">tempest-TaggedBootDevicesTest_v242-49110099-project-member</nova:user>
Aug 16 12:15:08 user nova-compute[73520]:         <nova:project uuid="644147b7898849d188d90d8faf1224c6">tempest-TaggedBootDevicesTest_v242-49110099</nova:project>
Aug 16 12:15:08 user nova-compute[73520]:       </nova:owner>
Aug 16 12:15:08 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:15:08 user nova-compute[73520]:       <nova:ports>
Aug 16 12:15:08 user nova-compute[73520]:         <nova:port uuid="ae0884bb-d1e5-41f4-82a1-cf1612acc3ef">
Aug 16 12:15:08 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 12:15:08 user nova-compute[73520]:         </nova:port>
Aug 16 12:15:08 user nova-compute[73520]:         <nova:port uuid="55dedb2f-d7f3-4f2e-bbff-90f53641c5ca">
Aug 16 12:15:08 user nova-compute[73520]:           <nova:ip type="fixed" address="10.1.1.153" ipVersion="4"/>
Aug 16 12:15:08 user nova-compute[73520]:         </nova:port>
Aug 16 12:15:08 user nova-compute[73520]:         <nova:port uuid="a983f522-a453-4636-a051-5780b31b3092">
Aug 16 12:15:08 user nova-compute[73520]:           <nova:ip type="fixed" address="10.1.1.209" ipVersion="4"/>
Aug 16 12:15:08 user nova-compute[73520]:         </nova:port>
Aug 16 12:15:08 user nova-compute[73520]:         <nova:port uuid="e289552d-05b7-418b-97c2-7d13c956b3fa">
Aug 16 12:15:08 user nova-compute[73520]:           <nova:ip type="fixed" address="10.1.1.54" ipVersion="4"/>
Aug 16 12:15:08 user nova-compute[73520]:         </nova:port>
Aug 16 12:15:08 user nova-compute[73520]:         <nova:port uuid="2c8f553a-1fb2-4a3b-80dd-0d549112f793">
Aug 16 12:15:08 user nova-compute[73520]:           <nova:ip type="fixed" address="10.1.1.123" ipVersion="4"/>
Aug 16 12:15:08 user nova-compute[73520]:         </nova:port>
Aug 16 12:15:08 user nova-compute[73520]:         <nova:port uuid="43824ad0-ef35-4471-9ce5-ffedc9f3784a">
Aug 16 12:15:08 user nova-compute[73520]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 12:15:08 user nova-compute[73520]:         </nova:port>
Aug 16 12:15:08 user nova-compute[73520]:         <nova:port uuid="c60f87c0-2d15-4360-8fa0-bf406fff942d">
Aug 16 12:15:08 user nova-compute[73520]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 12:15:08 user nova-compute[73520]:         </nova:port>
Aug 16 12:15:08 user nova-compute[73520]:       </nova:ports>
Aug 16 12:15:08 user nova-compute[73520]:     </nova:instance>
Aug 16 12:15:08 user nova-compute[73520]:   </metadata>
Aug 16 12:15:08 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:15:08 user nova-compute[73520]:     <system>
Aug 16 12:15:08 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:15:08 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:15:08 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:15:08 user nova-compute[73520]:       <entry name="serial">ff7477c9-0c43-4aff-a7c3-e9311c965f40</entry>
Aug 16 12:15:08 user nova-compute[73520]:       <entry name="uuid">ff7477c9-0c43-4aff-a7c3-e9311c965f40</entry>
Aug 16 12:15:08 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:15:08 user nova-compute[73520]:     </system>
Aug 16 12:15:08 user nova-compute[73520]:   </sysinfo>
Aug 16 12:15:08 user nova-compute[73520]:   <os>
Aug 16 12:15:08 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:15:08 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:15:08 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:15:08 user nova-compute[73520]:   </os>
Aug 16 12:15:08 user nova-compute[73520]:   <features>
Aug 16 12:15:08 user nova-compute[73520]:     <acpi/>
Aug 16 12:15:08 user nova-compute[73520]:     <apic/>
Aug 16 12:15:08 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:15:08 user nova-compute[73520]:   </features>
Aug 16 12:15:08 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:15:08 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:15:08 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:15:08 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:15:08 user nova-compute[73520]:   </clock>
Aug 16 12:15:08 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:15:08 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:15:08 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:15:08 user nova-compute[73520]:   </cpu>
Aug 16 12:15:08 user nova-compute[73520]:   <devices>
Aug 16 12:15:08 user nova-compute[73520]:     <disk type="file" device="cdrom">
Aug 16 12:15:08 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 12:15:08 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/ff7477c9-0c43-4aff-a7c3-e9311c965f40/disk.config"/>
Aug 16 12:15:08 user nova-compute[73520]:       <target dev="hda" bus="ide"/>
Aug 16 12:15:08 user nova-compute[73520]:     </disk>
Aug 16 12:15:08 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:15:08 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:15:08 user nova-compute[73520]:       <source dev="/dev/sdg"/>
Aug 16 12:15:08 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:15:08 user nova-compute[73520]:       <serial>d0318da1-09d3-4916-a9fb-8168456b93ad</serial>
Aug 16 12:15:08 user nova-compute[73520]:     </disk>
Aug 16 12:15:08 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:15:08 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:15:08 user nova-compute[73520]:       <source dev="/dev/sdh"/>
Aug 16 12:15:08 user nova-compute[73520]:       <target dev="vdb" bus="virtio"/>
Aug 16 12:15:08 user nova-compute[73520]:       <serial>5480195e-373a-4385-af13-1c5c8401ded9</serial>
Aug 16 12:15:08 user nova-compute[73520]:     </disk>
Aug 16 12:15:08 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:15:08 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:15:08 user nova-compute[73520]:       <source dev="/dev/sdi"/>
Aug 16 12:15:08 user nova-compute[73520]:       <target dev="vdc" bus="virtio"/>
Aug 16 12:15:08 user nova-compute[73520]:       <serial>1ca61a09-f1a6-438d-b4ef-2ca571993add</serial>
Aug 16 12:15:08 user nova-compute[73520]:     </disk>
Aug 16 12:15:08 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:15:08 user nova-compute[73520]:       <mac address="fa:16:3e:66:15:46"/>
Aug 16 12:15:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:15:08 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:15:08 user nova-compute[73520]:       <target dev="tapae0884bb-d1"/>
Aug 16 12:15:08 user nova-compute[73520]:     </interface>
Aug 16 12:15:08 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:15:08 user nova-compute[73520]:       <mac address="fa:16:3e:8e:ed:aa"/>
Aug 16 12:15:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:15:08 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:15:08 user nova-compute[73520]:       <target dev="tap55dedb2f-d7"/>
Aug 16 12:15:08 user nova-compute[73520]:     </interface>
Aug 16 12:15:08 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:15:08 user nova-compute[73520]:       <mac address="fa:16:3e:ee:53:42"/>
Aug 16 12:15:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:15:08 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:15:08 user nova-compute[73520]:       <target dev="tapa983f522-a4"/>
Aug 16 12:15:08 user nova-compute[73520]:     </interface>
Aug 16 12:15:08 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:15:08 user nova-compute[73520]:       <mac address="fa:16:3e:3b:4d:2d"/>
Aug 16 12:15:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:15:08 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:15:08 user nova-compute[73520]:       <target dev="tape289552d-05"/>
Aug 16 12:15:08 user nova-compute[73520]:     </interface>
Aug 16 12:15:08 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:15:08 user nova-compute[73520]:       <mac address="fa:16:3e:a8:d4:96"/>
Aug 16 12:15:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:15:08 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:15:08 user nova-compute[73520]:       <target dev="tap2c8f553a-1f"/>
Aug 16 12:15:08 user nova-compute[73520]:     </interface>
Aug 16 12:15:08 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:15:08 user nova-compute[73520]:       <mac address="fa:16:3e:4a:d3:74"/>
Aug 16 12:15:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:15:08 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:15:08 user nova-compute[73520]:       <target dev="tap43824ad0-ef"/>
Aug 16 12:15:08 user nova-compute[73520]:     </interface>
Aug 16 12:15:08 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:15:08 user nova-compute[73520]:       <mac address="fa:16:3e:d7:8c:a9"/>
Aug 16 12:15:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:15:08 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:15:08 user nova-compute[73520]:       <target dev="tapc60f87c0-2d"/>
Aug 16 12:15:08 user nova-compute[73520]:     </interface>
Aug 16 12:15:08 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:15:08 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/ff7477c9-0c43-4aff-a7c3-e9311c965f40/console.log" append="off"/>
Aug 16 12:15:08 user nova-compute[73520]:     </serial>
Aug 16 12:15:08 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:15:08 user nova-compute[73520]:     <video>
Aug 16 12:15:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:15:08 user nova-compute[73520]:     </video>
Aug 16 12:15:08 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:15:08 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:15:08 user nova-compute[73520]:     </rng>
Aug 16 12:15:08 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:15:08 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:15:08 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:15:08 user nova-compute[73520]:     </memballoon>
Aug 16 12:15:08 user nova-compute[73520]:   </devices>
Aug 16 12:15:08 user nova-compute[73520]: </domain>
Aug 16 12:15:08 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:15:46,bridge_name='br-int',has_traffic_filtering=True,id=ae0884bb-d1e5-41f4-82a1-cf1612acc3ef,network=Network(d4cc21ca-5d96-42cb-99ea-e8ac506baf8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0884bb-d1') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:15:46,bridge_name='br-int',has_traffic_filtering=True,id=ae0884bb-d1e5-41f4-82a1-cf1612acc3ef,network=Network(d4cc21ca-5d96-42cb-99ea-e8ac506baf8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0884bb-d1') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae0884bb-d1, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae0884bb-d1, col_values=(('external_ids', {'iface-id': 'ae0884bb-d1e5-41f4-82a1-cf1612acc3ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:15:46', 'vm-uuid': 'ff7477c9-0c43-4aff-a7c3-e9311c965f40'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: INFO os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:15:46,bridge_name='br-int',has_traffic_filtering=True,id=ae0884bb-d1e5-41f4-82a1-cf1612acc3ef,network=Network(d4cc21ca-5d96-42cb-99ea-e8ac506baf8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0884bb-d1')
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=55dedb2f-d7f3-4f2e-bbff-90f53641c5ca,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55dedb2f-d7') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=55dedb2f-d7f3-4f2e-bbff-90f53641c5ca,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55dedb2f-d7') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55dedb2f-d7, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55dedb2f-d7, col_values=(('external_ids', {'iface-id': '55dedb2f-d7f3-4f2e-bbff-90f53641c5ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:ed:aa', 'vm-uuid': 'ff7477c9-0c43-4aff-a7c3-e9311c965f40'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: INFO os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=55dedb2f-d7f3-4f2e-bbff-90f53641c5ca,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55dedb2f-d7')
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:53:42,bridge_name='br-int',has_traffic_filtering=True,id=a983f522-a453-4636-a051-5780b31b3092,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa983f522-a4') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:53:42,bridge_name='br-int',has_traffic_filtering=True,id=a983f522-a453-4636-a051-5780b31b3092,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa983f522-a4') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa983f522-a4, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa983f522-a4, col_values=(('external_ids', {'iface-id': 'a983f522-a453-4636-a051-5780b31b3092', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:53:42', 'vm-uuid': 'ff7477c9-0c43-4aff-a7c3-e9311c965f40'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: INFO os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:53:42,bridge_name='br-int',has_traffic_filtering=True,id=a983f522-a453-4636-a051-5780b31b3092,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa983f522-a4')
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=e289552d-05b7-418b-97c2-7d13c956b3fa,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape289552d-05') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=e289552d-05b7-418b-97c2-7d13c956b3fa,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape289552d-05') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape289552d-05, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape289552d-05, col_values=(('external_ids', {'iface-id': 'e289552d-05b7-418b-97c2-7d13c956b3fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:4d:2d', 'vm-uuid': 'ff7477c9-0c43-4aff-a7c3-e9311c965f40'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: INFO os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=e289552d-05b7-418b-97c2-7d13c956b3fa,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape289552d-05')
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=2c8f553a-1fb2-4a3b-80dd-0d549112f793,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f553a-1f') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=2c8f553a-1fb2-4a3b-80dd-0d549112f793,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f553a-1f') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c8f553a-1f, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c8f553a-1f, col_values=(('external_ids', {'iface-id': '2c8f553a-1fb2-4a3b-80dd-0d549112f793', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:d4:96', 'vm-uuid': 'ff7477c9-0c43-4aff-a7c3-e9311c965f40'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: INFO os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=2c8f553a-1fb2-4a3b-80dd-0d549112f793,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f553a-1f')
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "address": "fa:16:3e:4a:d3:74", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43824ad0-ef", "ovs_interfaceid": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "address": "fa:16:3e:4a:d3:74", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43824ad0-ef", "ovs_interfaceid": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=43824ad0-ef35-4471-9ce5-ffedc9f3784a,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43824ad0-ef') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=43824ad0-ef35-4471-9ce5-ffedc9f3784a,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43824ad0-ef') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43824ad0-ef, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43824ad0-ef, col_values=(('external_ids', {'iface-id': '43824ad0-ef35-4471-9ce5-ffedc9f3784a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:d3:74', 'vm-uuid': 'ff7477c9-0c43-4aff-a7c3-e9311c965f40'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: INFO os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=43824ad0-ef35-4471-9ce5-ffedc9f3784a,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43824ad0-ef')
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "address": "fa:16:3e:d7:8c:a9", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60f87c0-2d", "ovs_interfaceid": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "address": "fa:16:3e:d7:8c:a9", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60f87c0-2d", "ovs_interfaceid": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:8c:a9,bridge_name='br-int',has_traffic_filtering=True,id=c60f87c0-2d15-4360-8fa0-bf406fff942d,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60f87c0-2d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:8c:a9,bridge_name='br-int',has_traffic_filtering=True,id=c60f87c0-2d15-4360-8fa0-bf406fff942d,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60f87c0-2d') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc60f87c0-2d, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc60f87c0-2d, col_values=(('external_ids', {'iface-id': 'c60f87c0-2d15-4360-8fa0-bf406fff942d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:8c:a9', 'vm-uuid': 'ff7477c9-0c43-4aff-a7c3-e9311c965f40'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:15:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:08 user nova-compute[73520]: INFO os_vif [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:8c:a9,bridge_name='br-int',has_traffic_filtering=True,id=c60f87c0-2d15-4360-8fa0-bf406fff942d,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60f87c0-2d')
Aug 16 12:15:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] No BDM found with device name hda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:15:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:15:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] No VIF found with MAC fa:16:3e:66:15:46, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:15:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] No VIF found with MAC fa:16:3e:a8:d4:96, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:15:09 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Using config drive
Aug 16 12:15:09 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Creating config drive at /opt/stack/data/nova/instances/ff7477c9-0c43-4aff-a7c3-e9311c965f40/disk.config
Aug 16 12:15:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ff7477c9-0c43-4aff-a7c3-e9311c965f40/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdvikicxh {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ff7477c9-0c43-4aff-a7c3-e9311c965f40/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdvikicxh" returned: 0 in 0.058s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-5d6b5c7e-8e49-4861-9fa6-e64c93f5aab4 req-ea81a0a1-bc2f-4d8a-ad00-61b3fad82978 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5d6b5c7e-8e49-4861-9fa6-e64c93f5aab4 req-ea81a0a1-bc2f-4d8a-ad00-61b3fad82978 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5d6b5c7e-8e49-4861-9fa6-e64c93f5aab4 req-ea81a0a1-bc2f-4d8a-ad00-61b3fad82978 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5d6b5c7e-8e49-4861-9fa6-e64c93f5aab4 req-ea81a0a1-bc2f-4d8a-ad00-61b3fad82978 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-5d6b5c7e-8e49-4861-9fa6-e64c93f5aab4 req-ea81a0a1-bc2f-4d8a-ad00-61b3fad82978 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:11 user nova-compute[73520]: WARNING nova.compute.manager [req-5d6b5c7e-8e49-4861-9fa6-e64c93f5aab4 req-ea81a0a1-bc2f-4d8a-ad00-61b3fad82978 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef for instance with vm_state building and task_state spawning.
Aug 16 12:15:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:13 user nova-compute[73520]: WARNING nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef for instance with vm_state building and task_state spawning.
Aug 16 12:15:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:13 user nova-compute[73520]: WARNING nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca for instance with vm_state building and task_state spawning.
Aug 16 12:15:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:13 user nova-compute[73520]: WARNING nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca for instance with vm_state building and task_state spawning.
Aug 16 12:15:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-a983f522-a453-4636-a051-5780b31b3092 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-a983f522-a453-4636-a051-5780b31b3092 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:13 user nova-compute[73520]: WARNING nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-a983f522-a453-4636-a051-5780b31b3092 for instance with vm_state building and task_state spawning.
Aug 16 12:15:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-a983f522-a453-4636-a051-5780b31b3092 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-a983f522-a453-4636-a051-5780b31b3092 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:13 user nova-compute[73520]: WARNING nova.compute.manager [req-8d888a0d-d4b7-43a2-a1c7-edc39becfa80 req-82765125-6308-4d48-9b95-0e5d3e9ab025 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-a983f522-a453-4636-a051-5780b31b3092 for instance with vm_state building and task_state spawning.
Aug 16 12:15:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-c6dc6ad7-686c-4e33-b038-f94ca575c1aa req-491f2c5c-1637-4063-a7ca-fe11ab377d9f service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-c60f87c0-2d15-4360-8fa0-bf406fff942d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c6dc6ad7-686c-4e33-b038-f94ca575c1aa req-491f2c5c-1637-4063-a7ca-fe11ab377d9f service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c6dc6ad7-686c-4e33-b038-f94ca575c1aa req-491f2c5c-1637-4063-a7ca-fe11ab377d9f service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c6dc6ad7-686c-4e33-b038-f94ca575c1aa req-491f2c5c-1637-4063-a7ca-fe11ab377d9f service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-c6dc6ad7-686c-4e33-b038-f94ca575c1aa req-491f2c5c-1637-4063-a7ca-fe11ab377d9f service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-c60f87c0-2d15-4360-8fa0-bf406fff942d {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:13 user nova-compute[73520]: WARNING nova.compute.manager [req-c6dc6ad7-686c-4e33-b038-f94ca575c1aa req-491f2c5c-1637-4063-a7ca-fe11ab377d9f service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-c60f87c0-2d15-4360-8fa0-bf406fff942d for instance with vm_state building and task_state spawning.
Aug 16 12:15:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-e289552d-05b7-418b-97c2-7d13c956b3fa {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-e289552d-05b7-418b-97c2-7d13c956b3fa {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:15 user nova-compute[73520]: WARNING nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-e289552d-05b7-418b-97c2-7d13c956b3fa for instance with vm_state building and task_state spawning.
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-e289552d-05b7-418b-97c2-7d13c956b3fa {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-e289552d-05b7-418b-97c2-7d13c956b3fa {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:15 user nova-compute[73520]: WARNING nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-e289552d-05b7-418b-97c2-7d13c956b3fa for instance with vm_state building and task_state spawning.
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-2c8f553a-1fb2-4a3b-80dd-0d549112f793 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-2c8f553a-1fb2-4a3b-80dd-0d549112f793 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:15 user nova-compute[73520]: WARNING nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-2c8f553a-1fb2-4a3b-80dd-0d549112f793 for instance with vm_state building and task_state spawning.
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-2c8f553a-1fb2-4a3b-80dd-0d549112f793 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-2c8f553a-1fb2-4a3b-80dd-0d549112f793 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:15 user nova-compute[73520]: WARNING nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-2c8f553a-1fb2-4a3b-80dd-0d549112f793 for instance with vm_state building and task_state spawning.
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-43824ad0-ef35-4471-9ce5-ffedc9f3784a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-43824ad0-ef35-4471-9ce5-ffedc9f3784a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:15 user nova-compute[73520]: WARNING nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-43824ad0-ef35-4471-9ce5-ffedc9f3784a for instance with vm_state building and task_state spawning.
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-43824ad0-ef35-4471-9ce5-ffedc9f3784a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-43824ad0-ef35-4471-9ce5-ffedc9f3784a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:15 user nova-compute[73520]: WARNING nova.compute.manager [req-82238310-a5a6-4869-977e-2c6d717a52e8 req-5c4be0e8-15da-4661-8b78-aeccceaab115 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-43824ad0-ef35-4471-9ce5-ffedc9f3784a for instance with vm_state building and task_state spawning.
Aug 16 12:15:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-5f963bf1-249f-4d77-83f8-de3ceafbd04a req-a5e37a03-e377-4cb5-9f2e-e4ee7e60cdcc service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-c60f87c0-2d15-4360-8fa0-bf406fff942d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5f963bf1-249f-4d77-83f8-de3ceafbd04a req-a5e37a03-e377-4cb5-9f2e-e4ee7e60cdcc service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5f963bf1-249f-4d77-83f8-de3ceafbd04a req-a5e37a03-e377-4cb5-9f2e-e4ee7e60cdcc service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5f963bf1-249f-4d77-83f8-de3ceafbd04a req-a5e37a03-e377-4cb5-9f2e-e4ee7e60cdcc service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-5f963bf1-249f-4d77-83f8-de3ceafbd04a req-a5e37a03-e377-4cb5-9f2e-e4ee7e60cdcc service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-c60f87c0-2d15-4360-8fa0-bf406fff942d {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:15 user nova-compute[73520]: WARNING nova.compute.manager [req-5f963bf1-249f-4d77-83f8-de3ceafbd04a req-a5e37a03-e377-4cb5-9f2e-e4ee7e60cdcc service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-c60f87c0-2d15-4360-8fa0-bf406fff942d for instance with vm_state building and task_state spawning.
Aug 16 12:15:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBefwJoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:15 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:15 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:15 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c8023c-7c4f-472e-800d-76581eac9974]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:15:15 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af05b9b-82ac-44ef-a092-0940c1ad7235]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8] added
Aug 16 12:15:16 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c354fb65-24a4-453b-8908-56341149e360]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a3ce08-6e29-4c3a-969f-bb8d6548bf06]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MBefwJoP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MBefwJoP" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6722892-ec90-4917-a7d1-965a255a196b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MBefwJoP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43a4bc3-7b42-43e0-ba67-2ce289adf1c7]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e8622a-45b8-4b36-84d1-1fc99922f3bc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:16 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:16 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[453a8d52-9cbe-462e-820e-a14dbcba60ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8, portal: 172.16.0.220,3260]
Aug 16 12:15:16 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8, portal: 172.16.0.220,3260] successful.
Aug 16 12:15:16 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188116.2964005, ff7477c9-0c43-4aff-a7c3-e9311c965f40 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:15:16 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] VM Resumed (Lifecycle Event)
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7815e2-9e9a-4f86-865c-b8c77e5a8954]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:15:16 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Instance spawned successfully.
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a7606a-3ef2-4a26-9467-b6d98458f35d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:16 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:16 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:16 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:15:16 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188116.297094, ff7477c9-0c43-4aff-a7c3-e9311c965f40 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:15:16 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] VM Started (Lifecycle Event)
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8b2a15-7e68-4a6f-8f52-c389f28e7b56]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBefwJoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:15:16 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:15:16 user nova-compute[73520]: INFO nova.compute.manager [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Took 12.42 seconds to spawn the instance on the hypervisor.
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.utils [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[262c4711-18fe-4c14-a298-b36980a53cb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70cf06d-6bd7-464c-9c04-6f9c8073fbd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2078fbb9-ac17-4828-9e33-266eb2850b9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d4f4ad-0f3c-41a1-9812-13578a2aa743]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:16 user nova-compute[73520]: INFO nova.compute.manager [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Took 78.40 seconds to build instance.
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:15:16 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c9552b-d9d8-4813-a796-38bb7ed194f9]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG os_brick.utils [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Updating existing volume attachment record: edb31fcd-c925-4c20-b6a2-e0914d4f852c {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:15:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a6163ea9-1be4-483c-9110-341ae87fb3be tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 78.526s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '26637613633623365', 'path': '/dev/sdj'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637613633623365', 'path': '/dev/sdj'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:15:17 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lazy-loading 'flavor' on Instance uuid 4ce719c9-0210-414f-bbf3-37bfa392125c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] attach device xml: <disk type="block" device="disk">
Aug 16 12:15:17 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:15:17 user nova-compute[73520]:   <source dev="/dev/sdj"/>
Aug 16 12:15:17 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:15:17 user nova-compute[73520]:   <serial>b0759104-8aa8-479a-9860-378abe4372a8</serial>
Aug 16 12:15:17 user nova-compute[73520]: </disk>
Aug 16 12:15:17 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:15:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:15:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:15:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] No VIF found with MAC fa:16:3e:1d:41:db, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:15:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-93255129-fb23-4280-bd7e-89c59b122764 req-184b91cf-a08b-4425-a250-2960b2934460 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received event network-changed-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-93255129-fb23-4280-bd7e-89c59b122764 req-184b91cf-a08b-4425-a250-2960b2934460 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Refreshing instance network info cache due to event network-changed-dbb56176-1321-4be7-b72f-4c2bb0d9f9af. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-93255129-fb23-4280-bd7e-89c59b122764 req-184b91cf-a08b-4425-a250-2960b2934460 service nova] Acquiring lock "refresh_cache-2462cd5c-8c3b-49e6-82a9-6539c57edb1e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-93255129-fb23-4280-bd7e-89c59b122764 req-184b91cf-a08b-4425-a250-2960b2934460 service nova] Acquired lock "refresh_cache-2462cd5c-8c3b-49e6-82a9-6539c57edb1e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG nova.network.neutron [req-93255129-fb23-4280-bd7e-89c59b122764 req-184b91cf-a08b-4425-a250-2960b2934460 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Refreshing network info cache for port dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yusCefAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:20 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:20 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:20 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba96e843-09cc-4440-aa9e-20cdac06b0cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:15:20 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fab99c-6783-47c4-be59-9685fb2340a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981] added
Aug 16 12:15:20 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f2245f-545d-41a8-bc73-44b3bc20a448]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[79089f8e-9b70-44d8-ba31-b0270afdeb49]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yusCefAN {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yusCefAN" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a42a60-3416-417c-902c-809fc0b9b3bc]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yusCefAN'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[230249de-45e0-4271-9aed-f865e32dc8b7]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9673a4b-05c0-49f6-a512-dcef3afea09c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:20 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:20 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:20 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG nova.network.neutron [req-93255129-fb23-4280-bd7e-89c59b122764 req-184b91cf-a08b-4425-a250-2960b2934460 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Updated VIF entry in instance network info cache for port dbb56176-1321-4be7-b72f-4c2bb0d9f9af. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:15:20 user nova-compute[73520]: DEBUG nova.network.neutron [req-93255129-fb23-4280-bd7e-89c59b122764 req-184b91cf-a08b-4425-a250-2960b2934460 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Updating instance_info_cache with network_info: [{"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[376c9db9-76bc-4a79-bbc1-887753460337]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981, portal: 172.16.0.220,3260]
Aug 16 12:15:21 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981, portal: 172.16.0.220,3260] successful.
Aug 16 12:15:21 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-93255129-fb23-4280-bd7e-89c59b122764 req-184b91cf-a08b-4425-a250-2960b2934460 service nova] Releasing lock "refresh_cache-2462cd5c-8c3b-49e6-82a9-6539c57edb1e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8f80c2-0783-4cdd-954f-1e35b3cb4d7a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e71290d-ffa4-444c-af5b-4940cbf1355d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:21 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:21 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:21 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fe551c78-7f8f-41bf-a855-839903c355ae tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.859s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae271c4b-341d-4899-8f22-1740287dc9f9]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:15:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yusCefAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:15:21 user nova-compute[73520]: INFO nova.compute.manager [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Rebuilding instance
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2462cd5c-8c3b-49e6-82a9-6539c57edb1e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '23464346233303438', 'path': '/dev/sdk'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464346233303438', 'path': '/dev/sdk'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lazy-loading 'flavor' on Instance uuid 1e35c753-7af1-4047-ad06-8b5755207b8e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:15:22 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:15:22 user nova-compute[73520]:   <source dev="/dev/sdk"/>
Aug 16 12:15:22 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:15:22 user nova-compute[73520]:   <serial>8e2eb1e7-3e56-4952-abcb-74aad936e981</serial>
Aug 16 12:15:22 user nova-compute[73520]: </disk>
Aug 16 12:15:22 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lazy-loading 'pci_requests' on Instance uuid 2462cd5c-8c3b-49e6-82a9-6539c57edb1e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lazy-loading 'pci_devices' on Instance uuid 2462cd5c-8c3b-49e6-82a9-6539c57edb1e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lazy-loading 'resources' on Instance uuid 2462cd5c-8c3b-49e6-82a9-6539c57edb1e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lazy-loading 'migration_context' on Instance uuid 2462cd5c-8c3b-49e6-82a9-6539c57edb1e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73520) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af63f02f-848b-4c2a-ac58-744c6164347d tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] volume_snapshot_create: create_info: {'snapshot_id': '17a226d7-fe33-45ee-8007-58c252b163cc', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73520) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-af63f02f-848b-4c2a-ac58-744c6164347d tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] snap xml: <domainsnapshot>
Aug 16 12:15:22 user nova-compute[73520]:   <disks>
Aug 16 12:15:22 user nova-compute[73520]:     <disk name="/dev/sdj" snapshot="external" type="file">
Aug 16 12:15:22 user nova-compute[73520]:       <source file="/dev/new_file"/>
Aug 16 12:15:22 user nova-compute[73520]:     </disk>
Aug 16 12:15:22 user nova-compute[73520]:     <disk name="vda" snapshot="no"/>
Aug 16 12:15:22 user nova-compute[73520]:   </disks>
Aug 16 12:15:22 user nova-compute[73520]: </domainsnapshot>
Aug 16 12:15:22 user nova-compute[73520]:  {{(pid=73520) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-af63f02f-848b-4c2a-ac58-744c6164347d tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lazy-loading 'system_metadata' on Instance uuid 4ce719c9-0210-414f-bbf3-37bfa392125c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9e4058ff-1325-45c4-a3f1-e4b802da83b9 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] volume_snapshot_delete: delete_info: {'volume_id': 'b0759104-8aa8-479a-9860-378abe4372a8'} {{(pid=73520) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [None req-9e4058ff-1325-45c4-a3f1-e4b802da83b9 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Traceback (most recent call last):
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     if delete_info['type'] != 'qcow2':
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] KeyError: 'type'
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] 
Aug 16 12:15:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:22 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-af63f02f-848b-4c2a-ac58-744c6164347d tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [None req-af63f02f-848b-4c2a-ac58-744c6164347d tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Traceback (most recent call last):
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     rv = execute(f, *args, **kwargs)
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     six.reraise(c, e, tb)
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     raise value
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     rv = meth(*args, **kwargs)
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] 
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [None req-af63f02f-848b-4c2a-ac58-744c6164347d tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Traceback (most recent call last):
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     self._volume_snapshot_create(context, instance, guest,
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     rv = execute(f, *args, **kwargs)
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     six.reraise(c, e, tb)
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     raise value
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     rv = meth(*args, **kwargs)
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 12:15:22 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] 
Aug 16 12:15:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] No VIF found with MAC fa:16:3e:1f:c7:00, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-ce9ff9a9-683b-4513-8ab5-a28b235ab866 req-2b3f33f9-b054-477a-b2d8-53bc406434fb service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received event network-vif-unplugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ce9ff9a9-683b-4513-8ab5-a28b235ab866 req-2b3f33f9-b054-477a-b2d8-53bc406434fb service nova] Acquiring lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ce9ff9a9-683b-4513-8ab5-a28b235ab866 req-2b3f33f9-b054-477a-b2d8-53bc406434fb service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ce9ff9a9-683b-4513-8ab5-a28b235ab866 req-2b3f33f9-b054-477a-b2d8-53bc406434fb service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-ce9ff9a9-683b-4513-8ab5-a28b235ab866 req-2b3f33f9-b054-477a-b2d8-53bc406434fb service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] No waiting events found dispatching network-vif-unplugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:22 user nova-compute[73520]: WARNING nova.compute.manager [req-ce9ff9a9-683b-4513-8ab5-a28b235ab866 req-2b3f33f9-b054-477a-b2d8-53bc406434fb service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received unexpected event network-vif-unplugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af for instance with vm_state active and task_state rebuilding.
Aug 16 12:15:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:23 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Instance destroyed successfully.
Aug 16 12:15:23 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Instance destroyed successfully.
Aug 16 12:15:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:13:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1943253361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1649896200',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5lfnNQjk309WHNPoJplqkTWZJCEIgsyDnf1ntfB3MA1o2pn1nFQq7KWgW/Px4t5P3JE58yASksLFE80axLqKjOyguTxIgo/Xo+NW6ip7AMowz4RnKZLCPN8GpS0T7CgA==',key_name='tempest-keypair-280741756',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d27d28a99784c87ae3a67834abbcc38',ramdisk_id='',reservation_id='r-2ozrmaur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-847817773',owner_user_name='tempest-ServerActionsV293TestJSON-847817773-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cabd18e57f6f4859a0e86ab2e4360721',uuid=2462cd5c-8c3b-49e6-82a9-6539c57edb1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Converting VIF {"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_vif [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbb56176-13, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:23 user nova-compute[73520]: INFO os_vif [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13')
Aug 16 12:15:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfvZMXCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:23 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ee66d0-2513-4758-9320-7b52bc0f03df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40c8d6c-b135-4922-ab61-72c1bad3cc3f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:23 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:23 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:23 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c5d31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc12c42f-341f-43f7-926b-bd8835fe1cf5]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1e3434-66fb-4c68-b690-0c1ad595ca51]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[196a4f34-c05c-4617-93f8-501557d002a1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf8c169-452f-4076-8999-2e88b6d33e8d]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26331306536633834', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f8fc2939', '/dev/disk/by-id/scsi-1SCST_BIOf8fc2939-c10e6c84a05d3aee') {{(pid=84372) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e75b1b-2886-4518-805d-b61c3c26c3b0]: (4, None) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b980f015-d6a0-4264-9761-97f6282a2c83]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f522f323-9788-4d1f-a529-816bed49696e]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260]
Aug 16 12:15:23 user nova-compute[73520]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260] successful.
Aug 16 12:15:23 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e597b6d0-7fa3-41c5-8c8b-77f860a7f089]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] <== disconnect_volume: return (404ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:15:23 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Deleting instance files /opt/stack/data/nova/instances/2462cd5c-8c3b-49e6-82a9-6539c57edb1e_del
Aug 16 12:15:23 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Deletion of /opt/stack/data/nova/instances/2462cd5c-8c3b-49e6-82a9-6539c57edb1e_del complete
Aug 16 12:15:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-ad7c470a-494d-4d24-9482-b098224f39a3 req-7f0e7b14-1a31-4ae1-ac74-b1856ec4e19e service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received event network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ad7c470a-494d-4d24-9482-b098224f39a3 req-7f0e7b14-1a31-4ae1-ac74-b1856ec4e19e service nova] Acquiring lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ad7c470a-494d-4d24-9482-b098224f39a3 req-7f0e7b14-1a31-4ae1-ac74-b1856ec4e19e service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ad7c470a-494d-4d24-9482-b098224f39a3 req-7f0e7b14-1a31-4ae1-ac74-b1856ec4e19e service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-ad7c470a-494d-4d24-9482-b098224f39a3 req-7f0e7b14-1a31-4ae1-ac74-b1856ec4e19e service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] No waiting events found dispatching network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:24 user nova-compute[73520]: WARNING nova.compute.manager [req-ad7c470a-494d-4d24-9482-b098224f39a3 req-7f0e7b14-1a31-4ae1-ac74-b1856ec4e19e service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received unexpected event network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af for instance with vm_state active and task_state rebuilding.
Aug 16 12:15:24 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:15:26 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:15:26 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:15:27 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:15:27 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:15:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:15:27 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:15:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:27 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:15:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBSMxFPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:30 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:30 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:30 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [None req-9e4058ff-1325-45c4-a3f1-e4b802da83b9 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver 
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver 
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-bd6238d8-d924-4962-a4e5-7dd534516d4f)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver 
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver 
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver 
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcede0c-698b-4866-aefe-3105c3a06720]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver [None req-af63f02f-848b-4c2a-ac58-744c6164347d tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 17a226d7-fe33-45ee-8007-58c252b163cc could not be found.
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     raise value
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver 
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver 
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 17a226d7-fe33-45ee-8007-58c252b163cc could not be found. (HTTP 404) (Request-ID: req-c5189950-ac49-4481-97b7-2c05f34b0133)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver 
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver 
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 17a226d7-fe33-45ee-8007-58c252b163cc could not be found.
Aug 16 12:15:30 user nova-compute[73520]: ERROR nova.virt.libvirt.driver 
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:15:30 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server [None req-9e4058ff-1325-45c4-a3f1-e4b802da83b9 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Exception during message handling: KeyError: 'type'
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server 
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a3607b-f3c7-49ad-9cb2-7d0ee5f1de23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d] added
Aug 16 12:15:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server [None req-af63f02f-848b-4c2a-ac58-744c6164347d tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     raise value
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 12:15:30 user nova-compute[73520]: ERROR oslo_messaging.rpc.server 
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-84b57a24-8aa5-4508-b8ec-553349dcf343 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.287s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[158714c9-06cd-46d2-8fb4-449f3888cfc0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88def27-5d77-41e9-bb2c-5aacfdcde520]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBSMxFPq {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBSMxFPq" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c839c0d-27c9-44bb-a521-e14a311fa70a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBSMxFPq'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86ad466-fac1-48f3-abd6-4dbb2290dca7]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 2462cd5c-8c3b-49e6-82a9-6539c57edb1e could not be found.
Aug 16 12:15:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfvZMXCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:30 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[907146fc-97f6-45be-9f26-e16bf0f395f8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxwIFqeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:30 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40fbe8b-cc52-497d-af85-027e92fd67a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260]
Aug 16 12:15:30 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260] successful.
Aug 16 12:15:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: INFO nova.compute.manager [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Detaching volume b0759104-8aa8-479a-9860-378abe4372a8
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bb072c-50fb-4ca4-89ee-60e550b7d672]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ad67ae-88af-432b-8be7-e0884e009c72]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:30 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.480s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:15:30 user nova-compute[73520]: INFO nova.virt.block_device [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Attempting to driver detach volume b0759104-8aa8-479a-9860-378abe4372a8 from mountpoint /dev/vdb
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cd542c-e841-471d-b05a-44675bdf34af]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBSMxFPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Attempting to detach device vdb from instance 4ce719c9-0210-414f-bbf3-37bfa392125c from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 12:15:30 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:15:30 user nova-compute[73520]:   <source dev="/dev/sdj"/>
Aug 16 12:15:30 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:15:30 user nova-compute[73520]:   <serial>b0759104-8aa8-479a-9860-378abe4372a8</serial>
Aug 16 12:15:30 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:15:30 user nova-compute[73520]: </disk>
Aug 16 12:15:30 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:15:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:31 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Successfully detached device vdb from instance 4ce719c9-0210-414f-bbf3-37bfa392125c from the persistent domain config.
Aug 16 12:15:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ce719c9-0210-414f-bbf3-37bfa392125c from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 12:15:31 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:15:31 user nova-compute[73520]:   <source dev="/dev/sdj"/>
Aug 16 12:15:31 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:15:31 user nova-compute[73520]:   <serial>b0759104-8aa8-479a-9860-378abe4372a8</serial>
Aug 16 12:15:31 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:15:31 user nova-compute[73520]: </disk>
Aug 16 12:15:31 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188131.505685, 4ce719c9-0210-414f-bbf3-37bfa392125c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ce719c9-0210-414f-bbf3-37bfa392125c {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:15:31 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Successfully detached device vdb from instance 4ce719c9-0210-414f-bbf3-37bfa392125c from the live domain config.
Aug 16 12:15:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBefwJoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:31 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:15:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.014s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] <== connect_volume: return (2017ms) {'type': 'block', 'scsi_wwn': '26335326239636132', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335326239636132', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.773s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:32 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:15:32 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7051MB free_disk=25.63097381591797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "1e35c753-7af1-4047-ad06-8b5755207b8e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.objects.instance [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lazy-loading 'flavor' on Instance uuid c1492de2-3545-4ef7-bf3d-07e779d73f8d {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[999858c8-fa00-4a19-be35-15d868f4c1f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:32 user nova-compute[73520]: INFO nova.compute.manager [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Detaching volume 8e2eb1e7-3e56-4952-abcb-74aad936e981
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:15:32 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:15:32 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:15:32 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:15:32 user nova-compute[73520]:   <serial>f43ce2ed-f531-4871-ba93-cbfdb6101e9d</serial>
Aug 16 12:15:32 user nova-compute[73520]: </disk>
Aug 16 12:15:32 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a882f04f-c690-48d4-9385-477c41a4a361]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:32 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:32 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c121e10>, {}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Disconnecting from: [] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] <== disconnect_volume: return (1856ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.838s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:32 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:32 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a95bbe6-36de-4a81-8faa-777c0152aeef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:15:32 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:32 user nova-compute[73520]: INFO nova.virt.block_device [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Attempting to driver detach volume 8e2eb1e7-3e56-4952-abcb-74aad936e981 from mountpoint /dev/vdb
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Attempting to detach device vdb from instance 1e35c753-7af1-4047-ad06-8b5755207b8e from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:15:32 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:15:32 user nova-compute[73520]:   <source dev="/dev/sdk"/>
Aug 16 12:15:32 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:15:32 user nova-compute[73520]:   <serial>8e2eb1e7-3e56-4952-abcb-74aad936e981</serial>
Aug 16 12:15:32 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:15:32 user nova-compute[73520]: </disk>
Aug 16 12:15:32 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[969402e4-8d4f-4e29-8a5a-93cee36bfb66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525] added
Aug 16 12:15:32 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:32 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Successfully detached device vdb from instance 1e35c753-7af1-4047-ad06-8b5755207b8e from the persistent domain config.
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e35c753-7af1-4047-ad06-8b5755207b8e from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:15:32 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:15:32 user nova-compute[73520]:   <source dev="/dev/sdk"/>
Aug 16 12:15:32 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:15:32 user nova-compute[73520]:   <serial>8e2eb1e7-3e56-4952-abcb-74aad936e981</serial>
Aug 16 12:15:32 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:15:32 user nova-compute[73520]: </disk>
Aug 16 12:15:32 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce801cad-68f0-43f6-ad40-5496e17bcfaf]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 636510f6-acfa-4705-bfb1-03df3f9297be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1e35c753-7af1-4047-ad06-8b5755207b8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4ace588c-2910-477d-a2f1-259bea336e38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4ce719c9-0210-414f-bbf3-37bfa392125c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance c1492de2-3545-4ef7-bf3d-07e779d73f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1c83f328-2bad-4efa-98f1-2568dcf6a0c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2462cd5c-8c3b-49e6-82a9-6539c57edb1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ff7477c9-0c43-4aff-a7c3-e9311c965f40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d35ff623-3cb2-420f-98c6-9da333fa5cee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ea9ce4f-479a-42c5-8610-1d1edd06e199 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d609463-b4b0-4a51-b090-f9369b0c2835]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxwIFqeY {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxwIFqeY" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeedf6d-7d22-4800-b5bd-2acfc0ddb4c3]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PxwIFqeY'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c5ca4e-9290-4ce9-a9b4-91220520e96f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1630f6fb-d8b2-4e38-85c5-4aefda02d745]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:32 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:32 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:32 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7985b68-f1ae-46b7-9d28-d71de3b8dca7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525, portal: 172.16.0.220,3260]
Aug 16 12:15:32 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525, portal: 172.16.0.220,3260] successful.
Aug 16 12:15:32 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6725aedc-be3a-4321-b1f6-ce259aeaf704]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8f8288-c06d-47a8-a33e-262e6071ea15]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:33 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] HCTL ('43', '-', '-', 0) found on session 14 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcb8e5c-7520-48fb-bcd6-d4d10a8278ee]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Searching for a device in session 14 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Connected to sdl using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxwIFqeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] No VIF found with MAC fa:16:3e:4b:49:90, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eef22e3e-eecf-45e4-866d-22646e46206d tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.040s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188133.3164246, 1e35c753-7af1-4047-ad06-8b5755207b8e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e35c753-7af1-4047-ad06-8b5755207b8e {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:15:33 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Successfully detached device vdb from instance 1e35c753-7af1-4047-ad06-8b5755207b8e from the live domain config.
Aug 16 12:15:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yusCefAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:33 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Preparing to wait for external event volume-reimaged-f1a466b2-9d08-4a37-9932-1b71914de525 {{(pid=73520) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.508s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] <== connect_volume: return (3347ms) {'type': 'block', 'scsi_wwn': '23834386162326465', 'path': '/dev/sdl'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834386162326465', 'path': '/dev/sdl'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.546s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d945b8e-0049-4c95-880f-5ca5f30418b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG nova.objects.instance [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lazy-loading 'flavor' on Instance uuid 4ace588c-2910-477d-a2f1-259bea336e38 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:15:34 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:15:34 user nova-compute[73520]:   <source dev="/dev/sdl"/>
Aug 16 12:15:34 user nova-compute[73520]:   <target dev="sdc" bus="scsi"/>
Aug 16 12:15:34 user nova-compute[73520]:   <serial>a5e30949-a1cb-46fb-ada6-7a886eba6525</serial>
Aug 16 12:15:34 user nova-compute[73520]:   <address type="drive" controller="0" unit="2"/>
Aug 16 12:15:34 user nova-compute[73520]: </disk>
Aug 16 12:15:34 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[360aaf39-d729-4995-bff4-ae8eabb9fd57]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c7af490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8'): ({'sdj'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Removing single pathed devices sdj {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f831ad-683e-4492-8788-217050347e48]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bfcba8-d3c5-43e7-8e48-2340b270b4be]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Flushing IO for device /dev/sdj {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[20aeef6e-283f-4302-8858-5f7c8e3cec92]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.061s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbb48ce-11f1-4dfd-b1e1-48337c06da79]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] SCSI volumes sdj have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f351361-4aa9-456e-8544-243c4095649b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f6ffa5-b3cc-4537-9fb6-da9763a3b458]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8, portal: 172.16.0.220,3260]
Aug 16 12:15:34 user nova-compute[73520]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8, portal: 172.16.0.220,3260] successful.
Aug 16 12:15:34 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0759104-8aa8-479a-9860-378abe4372a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea4563a-a2cd-40bc-b209-0b21b1955bde]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] <== disconnect_volume: return (2967ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.175s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9c4765-c46e-4ca3-b100-bc244bbf757a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4053ce-a9d2-45db-98ce-aba8c0e47b23]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:34 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:34 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c7acaf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981'): ({'sdk'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Removing single pathed devices sdk {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce35a4a9-e17b-442b-b03a-6f0f82ee26a8]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[590398cc-8703-4fdc-b917-a79fde471b4b]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Flushing IO for device /dev/sdk {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9166cb0-f88e-495a-93cf-001871c1bbb9]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] No BDM found with device name sda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] No VIF found with MAC fa:16:3e:e8:1c:7e, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.054s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15cd0e8-2f46-4e47-b911-ef43af8da337]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] SCSI volumes sdk have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6720f0d-95ec-4d6f-9341-98020f12556f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Acquiring lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.utils [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ef0ea6-02e9-404a-a095-8cbe6674d11f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d9df29-e41a-4507-b3ef-4e901ff17d7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6013f23d-7acd-4461-a67a-b49af292cad8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3842b2-f491-4df2-a9a3-4eff53d5a752]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updating instance_info_cache with network_info: [{"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --logout" returned: 0 in 0.151s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c256e83-3590-4310-81fc-9742ebda4b26]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981, portal: 172.16.0.220,3260]
Aug 16 12:15:34 user nova-compute[73520]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981, portal: 172.16.0.220,3260] successful.
Aug 16 12:15:34 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:15:34 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae2e51e-3c5f-432e-9150-d3bb55a99b1d]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.utils [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e2eb1e7-3e56-4952-abcb-74aad936e981 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[993b8f61-6860-4cac-a6fe-ca2aa9a2c3f0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.490s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] <== disconnect_volume: return (1664ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:15:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-bdc1a100-28d3-493c-9226-57ca0f2ff0cc tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "4ace588c-2910-477d-a2f1-259bea336e38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.565s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Swapping volume f43ce2ed-f531-4871-ba93-cbfdb6101e9d for f66df159-3973-4db8-b857-6b1245c616ad
Aug 16 12:15:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:38 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188123.2522578, 2462cd5c-8c3b-49e6-82a9-6539c57edb1e => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:15:38 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] VM Stopped (Lifecycle Event)
Aug 16 12:15:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-10b6e54a-6a05-41f7-8417-4a33fcf29ca2 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:15:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:39 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lazy-loading 'flavor' on Instance uuid 4ce719c9-0210-414f-bbf3-37bfa392125c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fda43c0c-1bca-499e-8696-3338adf60564 tempest-VolumesAssistedSnapshotsTest-1660695326 tempest-VolumesAssistedSnapshotsTest-1660695326-project-admin] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.773s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:39 user nova-compute[73520]: DEBUG nova.objects.instance [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lazy-loading 'flavor' on Instance uuid 1e35c753-7af1-4047-ad06-8b5755207b8e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-03e9ee63-275e-4c8e-af11-761d2c86b051 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.429s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "4ace588c-2910-477d-a2f1-259bea336e38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "4ace588c-2910-477d-a2f1-259bea336e38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:40 user nova-compute[73520]: INFO nova.compute.manager [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Detaching volume a5e30949-a1cb-46fb-ada6-7a886eba6525
Aug 16 12:15:40 user nova-compute[73520]: INFO nova.virt.block_device [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Attempting to driver detach volume a5e30949-a1cb-46fb-ada6-7a886eba6525 from mountpoint /dev/sdc
Aug 16 12:15:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Attempting to detach device sdc from instance 4ace588c-2910-477d-a2f1-259bea336e38 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:15:40 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:15:40 user nova-compute[73520]:   <source dev="/dev/sdl"/>
Aug 16 12:15:40 user nova-compute[73520]:   <target dev="sdc" bus="scsi"/>
Aug 16 12:15:40 user nova-compute[73520]:   <serial>a5e30949-a1cb-46fb-ada6-7a886eba6525</serial>
Aug 16 12:15:40 user nova-compute[73520]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 12:15:40 user nova-compute[73520]: </disk>
Aug 16 12:15:40 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:15:40 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Successfully detached device sdc from instance 4ace588c-2910-477d-a2f1-259bea336e38 from the persistent domain config.
Aug 16 12:15:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 4ace588c-2910-477d-a2f1-259bea336e38 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:15:40 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:15:40 user nova-compute[73520]:   <source dev="/dev/sdl"/>
Aug 16 12:15:40 user nova-compute[73520]:   <target dev="sdc" bus="scsi"/>
Aug 16 12:15:40 user nova-compute[73520]:   <serial>a5e30949-a1cb-46fb-ada6-7a886eba6525</serial>
Aug 16 12:15:40 user nova-compute[73520]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 12:15:40 user nova-compute[73520]: </disk>
Aug 16 12:15:40 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188140.7923465, 4ace588c-2910-477d-a2f1-259bea336e38 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 4ace588c-2910-477d-a2f1-259bea336e38 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:15:40 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Successfully detached device sdc from instance 4ace588c-2910-477d-a2f1-259bea336e38 from the live domain config.
Aug 16 12:15:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxwIFqeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:40 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfc6225-b6b3-42cb-8d93-f44f71d1ec7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c448d35-37f1-4765-ad82-0d6e1693eaac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:40 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:40 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:40 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c121480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525'): ({'sdl'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Removing single pathed devices sdl {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea95cf1-6028-404f-8ff4-7dc46a0b7755]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b9e57f-bc1a-41ba-87ac-9331c05a34dd]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Flushing IO for device /dev/sdl {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dbbf18-3dbb-4820-afe8-23e723f33bad]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.040s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daaf533-e5b7-42b9-bbb1-475b62626d3d]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:15:40 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] SCSI volumes sdl have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[30147f63-6870-4a0f-bbb1-26b4308ce9e0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cac7d66-06aa-4285-b45d-bb860c4e50f5]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525, portal: 172.16.0.220,3260]
Aug 16 12:15:41 user nova-compute[73520]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525, portal: 172.16.0.220,3260] successful.
Aug 16 12:15:41 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e30949-a1cb-46fb-ada6-7a886eba6525 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c0cedb-f2fd-4b7e-86eb-6a3820b6225b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] <== disconnect_volume: return (343ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG nova.objects.instance [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lazy-loading 'flavor' on Instance uuid 4ace588c-2910-477d-a2f1-259bea336e38 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-32598564-ce3f-44a0-baa7-c9aad4b084b2 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "4ace588c-2910-477d-a2f1-259bea336e38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.676s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "4ace588c-2910-477d-a2f1-259bea336e38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "4ace588c-2910-477d-a2f1-259bea336e38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "4ace588c-2910-477d-a2f1-259bea336e38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "4ace588c-2910-477d-a2f1-259bea336e38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "4ace588c-2910-477d-a2f1-259bea336e38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:42 user nova-compute[73520]: INFO nova.compute.manager [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Terminating instance
Aug 16 12:15:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-9cceba90-9798-44eb-8cf5-474497da3662 req-52cf1bfe-fb60-4e38-b157-0a6a38920745 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Received event network-vif-unplugged-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9cceba90-9798-44eb-8cf5-474497da3662 req-52cf1bfe-fb60-4e38-b157-0a6a38920745 service nova] Acquiring lock "4ace588c-2910-477d-a2f1-259bea336e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9cceba90-9798-44eb-8cf5-474497da3662 req-52cf1bfe-fb60-4e38-b157-0a6a38920745 service nova] Lock "4ace588c-2910-477d-a2f1-259bea336e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9cceba90-9798-44eb-8cf5-474497da3662 req-52cf1bfe-fb60-4e38-b157-0a6a38920745 service nova] Lock "4ace588c-2910-477d-a2f1-259bea336e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-9cceba90-9798-44eb-8cf5-474497da3662 req-52cf1bfe-fb60-4e38-b157-0a6a38920745 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] No waiting events found dispatching network-vif-unplugged-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-9cceba90-9798-44eb-8cf5-474497da3662 req-52cf1bfe-fb60-4e38-b157-0a6a38920745 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Received event network-vif-unplugged-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:43 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Instance destroyed successfully.
Aug 16 12:15:43 user nova-compute[73520]: DEBUG nova.objects.instance [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lazy-loading 'resources' on Instance uuid 4ace588c-2910-477d-a2f1-259bea336e38 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1128776314',display_name='tempest-AttachSCSIVolumeTestJSON-server-1128776314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1128776314',id=6,image_ref='a0193d69-19d3-4f14-83dd-e1ef7fd72f94',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYk3E9/H1rqfMrntRWASDDvpP6+7XvAxnmGO38E6/Gs5pyUke6CcqNYk47oDD3m7CziNw8ESyVLYJmKlz60Tpq5gLVZ+klL3vvIzsQM0HjCGlgjNPn2si5TUQjxsmelbg==',key_name='tempest-keypair-1633517254',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff63ee7d988f4c40a4233d32238331d0',ramdisk_id='',reservation_id='r-ispiuvwa',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0193d69-19d3-4f14-83dd-e1ef7fd72f94',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-21731701',owner_user_name='tempest-AttachSCSIVolumeTestJSON-21731701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0286fa8b7da84be9a0fdea8a09656dde',uuid=4ace588c-2910-477d-a2f1-259bea336e38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "address": "fa:16:3e:e8:1c:7e", "network": {"id": "a9472174-9ce5-4cb7-a698-35f03a009863", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-924117371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63ee7d988f4c40a4233d32238331d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1674c7c-7e", "ovs_interfaceid": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Converting VIF {"id": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "address": "fa:16:3e:e8:1c:7e", "network": {"id": "a9472174-9ce5-4cb7-a698-35f03a009863", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-924117371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63ee7d988f4c40a4233d32238331d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1674c7c-7e", "ovs_interfaceid": "d1674c7c-7ec6-4ec5-b898-2afd3fcad071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d1674c7c-7ec6-4ec5-b898-2afd3fcad071,network=Network(a9472174-9ce5-4cb7-a698-35f03a009863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1674c7c-7e') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG os_vif [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d1674c7c-7ec6-4ec5-b898-2afd3fcad071,network=Network(a9472174-9ce5-4cb7-a698-35f03a009863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1674c7c-7e') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1674c7c-7e, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:15:43 user nova-compute[73520]: INFO os_vif [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=d1674c7c-7ec6-4ec5-b898-2afd3fcad071,network=Network(a9472174-9ce5-4cb7-a698-35f03a009863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1674c7c-7e')
Aug 16 12:15:43 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Deleting instance files /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38_del
Aug 16 12:15:43 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Deletion of /opt/stack/data/nova/instances/4ace588c-2910-477d-a2f1-259bea336e38_del complete
Aug 16 12:15:44 user nova-compute[73520]: INFO nova.compute.manager [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 16 12:15:44 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:15:44 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:15:44 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:15:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-dda4910d-2397-4b52-8f3d-aab8c4244813 req-f5ae6e83-6379-45e1-bc26-cdfca253027b service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Received event network-vif-deleted-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:45 user nova-compute[73520]: INFO nova.compute.manager [req-dda4910d-2397-4b52-8f3d-aab8c4244813 req-f5ae6e83-6379-45e1-bc26-cdfca253027b service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Neutron deleted interface d1674c7c-7ec6-4ec5-b898-2afd3fcad071; detaching it from the instance and deleting it from the info cache
Aug 16 12:15:45 user nova-compute[73520]: DEBUG nova.network.neutron [req-dda4910d-2397-4b52-8f3d-aab8c4244813 req-f5ae6e83-6379-45e1-bc26-cdfca253027b service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:15:45 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:15:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-dda4910d-2397-4b52-8f3d-aab8c4244813 req-f5ae6e83-6379-45e1-bc26-cdfca253027b service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Detach interface failed, port_id=d1674c7c-7ec6-4ec5-b898-2afd3fcad071, reason: Instance 4ace588c-2910-477d-a2f1-259bea336e38 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:15:45 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Took 1.56 seconds to deallocate network for instance.
Aug 16 12:15:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-a8288391-82ae-46a6-a879-0269c3decf49 req-c1a640e0-c407-4d68-9de5-1a995f7dd612 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Received event network-vif-plugged-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a8288391-82ae-46a6-a879-0269c3decf49 req-c1a640e0-c407-4d68-9de5-1a995f7dd612 service nova] Acquiring lock "4ace588c-2910-477d-a2f1-259bea336e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a8288391-82ae-46a6-a879-0269c3decf49 req-c1a640e0-c407-4d68-9de5-1a995f7dd612 service nova] Lock "4ace588c-2910-477d-a2f1-259bea336e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a8288391-82ae-46a6-a879-0269c3decf49 req-c1a640e0-c407-4d68-9de5-1a995f7dd612 service nova] Lock "4ace588c-2910-477d-a2f1-259bea336e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-a8288391-82ae-46a6-a879-0269c3decf49 req-c1a640e0-c407-4d68-9de5-1a995f7dd612 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] No waiting events found dispatching network-vif-plugged-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:45 user nova-compute[73520]: WARNING nova.compute.manager [req-a8288391-82ae-46a6-a879-0269c3decf49 req-c1a640e0-c407-4d68-9de5-1a995f7dd612 service nova] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Received unexpected event network-vif-plugged-d1674c7c-7ec6-4ec5-b898-2afd3fcad071 for instance with vm_state deleted and task_state None.
Aug 16 12:15:46 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:46 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Deleted allocations for instance 4ace588c-2910-477d-a2f1-259bea336e38
Aug 16 12:15:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Acquiring lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Acquiring lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:46 user nova-compute[73520]: INFO nova.compute.manager [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Terminating instance
Aug 16 12:15:46 user nova-compute[73520]: DEBUG nova.compute.manager [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21e4639b-e182-42bd-9780-5e44d1337d78 tempest-AttachSCSIVolumeTestJSON-21731701 tempest-AttachSCSIVolumeTestJSON-21731701-project-member] Lock "4ace588c-2910-477d-a2f1-259bea336e38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.390s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-29b4781f-c675-49ef-ac03-5f32a276e2fe req-9dd7d804-1e7d-4f3a-aa8e-0e8e5988b796 service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Received event network-vif-unplugged-8eccd7a5-fc0e-4248-b18b-576f6433e2ff {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-29b4781f-c675-49ef-ac03-5f32a276e2fe req-9dd7d804-1e7d-4f3a-aa8e-0e8e5988b796 service nova] Acquiring lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-29b4781f-c675-49ef-ac03-5f32a276e2fe req-9dd7d804-1e7d-4f3a-aa8e-0e8e5988b796 service nova] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-29b4781f-c675-49ef-ac03-5f32a276e2fe req-9dd7d804-1e7d-4f3a-aa8e-0e8e5988b796 service nova] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-29b4781f-c675-49ef-ac03-5f32a276e2fe req-9dd7d804-1e7d-4f3a-aa8e-0e8e5988b796 service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] No waiting events found dispatching network-vif-unplugged-8eccd7a5-fc0e-4248-b18b-576f6433e2ff {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-29b4781f-c675-49ef-ac03-5f32a276e2fe req-9dd7d804-1e7d-4f3a-aa8e-0e8e5988b796 service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Received event network-vif-unplugged-8eccd7a5-fc0e-4248-b18b-576f6433e2ff for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:47 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Instance destroyed successfully.
Aug 16 12:15:47 user nova-compute[73520]: DEBUG nova.objects.instance [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lazy-loading 'resources' on Instance uuid 1c83f328-2bad-4efa-98f1-2568dcf6a0c3 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:13:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1697652939',display_name='tempest-VolumesActionsTest-instance-1697652939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1697652939',id=9,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:13:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcef9eab49a2463c945c9cb72ff61399',ramdisk_id='',reservation_id='r-j0f6cmy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1618629274',owner_user_name='tempest-VolumesActionsTest-1618629274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:13:33Z,user_data=None,user_id='168c3c187ad945d189d02b6673421f28',uuid=1c83f328-2bad-4efa-98f1-2568dcf6a0c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "address": "fa:16:3e:e1:b5:4a", "network": {"id": "e08ad002-b4ec-4b1f-a853-17fca3a8321f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-122744988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcef9eab49a2463c945c9cb72ff61399", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eccd7a5-fc", "ovs_interfaceid": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Converting VIF {"id": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "address": "fa:16:3e:e1:b5:4a", "network": {"id": "e08ad002-b4ec-4b1f-a853-17fca3a8321f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-122744988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcef9eab49a2463c945c9cb72ff61399", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eccd7a5-fc", "ovs_interfaceid": "8eccd7a5-fc0e-4248-b18b-576f6433e2ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=8eccd7a5-fc0e-4248-b18b-576f6433e2ff,network=Network(e08ad002-b4ec-4b1f-a853-17fca3a8321f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eccd7a5-fc') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG os_vif [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=8eccd7a5-fc0e-4248-b18b-576f6433e2ff,network=Network(e08ad002-b4ec-4b1f-a853-17fca3a8321f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eccd7a5-fc') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eccd7a5-fc, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:47 user nova-compute[73520]: INFO os_vif [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:b5:4a,bridge_name='br-int',has_traffic_filtering=True,id=8eccd7a5-fc0e-4248-b18b-576f6433e2ff,network=Network(e08ad002-b4ec-4b1f-a853-17fca3a8321f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eccd7a5-fc')
Aug 16 12:15:47 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Deleting instance files /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3_del
Aug 16 12:15:47 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Deletion of /opt/stack/data/nova/instances/1c83f328-2bad-4efa-98f1-2568dcf6a0c3_del complete
Aug 16 12:15:47 user nova-compute[73520]: INFO nova.compute.manager [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 16 12:15:47 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:15:47 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Took 0.59 seconds to deallocate network for instance.
Aug 16 12:15:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-e8b84440-8428-4f83-a045-e528aa46607d req-e2f35508-5046-4c04-bee7-44ecaf9000eb service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Received event network-vif-deleted-8eccd7a5-fc0e-4248-b18b-576f6433e2ff {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:47 user nova-compute[73520]: INFO nova.compute.manager [req-e8b84440-8428-4f83-a045-e528aa46607d req-e2f35508-5046-4c04-bee7-44ecaf9000eb service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Neutron deleted interface 8eccd7a5-fc0e-4248-b18b-576f6433e2ff; detaching it from the instance and deleting it from the info cache
Aug 16 12:15:47 user nova-compute[73520]: DEBUG nova.network.neutron [req-e8b84440-8428-4f83-a045-e528aa46607d req-e2f35508-5046-4c04-bee7-44ecaf9000eb service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-e8b84440-8428-4f83-a045-e528aa46607d req-e2f35508-5046-4c04-bee7-44ecaf9000eb service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Detach interface failed, port_id=8eccd7a5-fc0e-4248-b18b-576f6433e2ff, reason: Instance 1c83f328-2bad-4efa-98f1-2568dcf6a0c3 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:48 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Deleted allocations for instance 1c83f328-2bad-4efa-98f1-2568dcf6a0c3
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8e54f37f-1420-4945-a717-770164248f93 tempest-VolumesActionsTest-1618629274 tempest-VolumesActionsTest-1618629274-project-member] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.087s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewuIDYNG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c1492de2-3545-4ef7-bf3d-07e779d73f8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f66df159-3973-4db8-b857-6b1245c616ad', 'serial': 'f66df159-3973-4db8-b857-6b1245c616ad'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBSMxFPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c1492de2-3545-4ef7-bf3d-07e779d73f8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f43ce2ed-f531-4871-ba93-cbfdb6101e9d', 'serial'} {{(pid=73520) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewuIDYNG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:48 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:48 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:48 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2bb70c-ef73-41c6-8d22-279f607523b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:15:48 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9816f75-99d9-4694-864a-96963d87118f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad] added
Aug 16 12:15:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a412ea-156c-4c24-a89e-a5b454e7c26a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2233aa98-0bc5-4c3e-8a8d-055ae943e25f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewuIDYNG {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-33bff2d6-bf11-4588-b42e-b29f339de492 req-85e6db4b-c399-48cd-8f98-fa8e948fa18c service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Received event network-vif-plugged-8eccd7a5-fc0e-4248-b18b-576f6433e2ff {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-33bff2d6-bf11-4588-b42e-b29f339de492 req-85e6db4b-c399-48cd-8f98-fa8e948fa18c service nova] Acquiring lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-33bff2d6-bf11-4588-b42e-b29f339de492 req-85e6db4b-c399-48cd-8f98-fa8e948fa18c service nova] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-33bff2d6-bf11-4588-b42e-b29f339de492 req-85e6db4b-c399-48cd-8f98-fa8e948fa18c service nova] Lock "1c83f328-2bad-4efa-98f1-2568dcf6a0c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-33bff2d6-bf11-4588-b42e-b29f339de492 req-85e6db4b-c399-48cd-8f98-fa8e948fa18c service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] No waiting events found dispatching network-vif-plugged-8eccd7a5-fc0e-4248-b18b-576f6433e2ff {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:15:48 user nova-compute[73520]: WARNING nova.compute.manager [req-33bff2d6-bf11-4588-b42e-b29f339de492 req-85e6db4b-c399-48cd-8f98-fa8e948fa18c service nova] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Received unexpected event network-vif-plugged-8eccd7a5-fc0e-4248-b18b-576f6433e2ff for instance with vm_state deleted and task_state None.
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewuIDYNG" returned: 0 in 0.156s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e46ed4f-6936-4091-a8f8-333fd1460bae]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ewuIDYNG'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a076f7-6b13-4627-bdf4-14a26186b019]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[111fec6d-20f4-447b-b630-948934d7ec44]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c90f4a-b0a6-4a98-b5c3-543260249be4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad, portal: 172.16.0.220,3260]
Aug 16 12:15:48 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad, portal: 172.16.0.220,3260] successful.
Aug 16 12:15:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66cc896-442c-45b3-9b2e-0abbeb1803c0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c825ab0-e943-4ac8-9dbf-d6493ed31ac7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:48 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.485s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] HCTL ('42', '-', '-', 0) found on session 16 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdc75ea-1c42-4ead-b671-18cf5bd10686]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Searching for a device in session 16 and hctl ['42', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:15:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Searching for a device in session 16 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:15:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewuIDYNG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:15:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.523s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] <== connect_volume: return (1524ms) {'type': 'block', 'scsi_wwn': '23765323433346463', 'path': '/dev/sdk'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765323433346463', 'path': '/dev/sdk'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:15:49 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lazy-loading 'flavor' on Instance uuid c1492de2-3545-4ef7-bf3d-07e779d73f8d {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:15:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:15:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 89128960 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:15:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 251658240 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:15:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 448790528 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:15:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 609222656 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:15:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 715128832 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:15:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 898629632 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:15:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 981467136 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:15:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 1033895936 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:15:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 1064304640 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBSMxFPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:55 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcf0df9-9ce8-439e-8444-4f23d0f41f34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4f1c2c-10cc-48d9-8991-9416e1b3ad9f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:55 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:15:55 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:15:55 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c6196c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[73431c3c-3f8e-4602-a70b-d9226deb434c]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[760957ae-e9ba-4cf2-94b4-03984454499e]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d36efe-3336-402f-a8bd-bc52fb00f3ea]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbacd50-2597-418d-84d3-d57969a88ca1]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e96af7f-f33e-45fc-b012-35577e4c376c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.163s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4b19f6-8796-4696-94a6-16dcdc9e63fc]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260]
Aug 16 12:15:55 user nova-compute[73520]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260] successful.
Aug 16 12:15:55 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[303efd80-0e68-4147-af96-8ca7aafc4b9f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:15:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:15:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] <== disconnect_volume: return (413ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:15:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewuIDYNG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'c1492de2-3545-4ef7-bf3d-07e779d73f8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f66df159-3973-4db8-b857-6b1245c616ad', 'serial'} {{(pid=73520) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 12:15:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] swap_volume: removing Cinder connection for volume f43ce2ed-f531-4871-ba93-cbfdb6101e9d {{(pid=73520) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 12:15:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:15:57 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] swap_volume: Updating volume f43ce2ed-f531-4871-ba93-cbfdb6101e9d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "ewuIDYNG", "auth_password": "i4EynGhAztfcNe", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "f66df159-3973-4db8-b857-6b1245c616ad"}, "status": "reserved", "instance": "c1492de2-3545-4ef7-bf3d-07e779d73f8d", "attached_at": "", "detached_at": "", "volume_id": "f66df159-3973-4db8-b857-6b1245c616ad", "serial": "f66df159-3973-4db8-b857-6b1245c616ad"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f66df159-3973-4db8-b857-6b1245c616ad', 'no_device': None, 'attachment_id': 'd1e6441a-a5a8-4f1e-a00c-5146c8e24399'} {{(pid=73520) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 12:15:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c3b3d66d-c0f1-4843-baa4-0bb2bba300b9 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 23.209s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:58 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188143.9235027, 4ace588c-2910-477d-a2f1-259bea336e38 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:15:58 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] VM Stopped (Lifecycle Event)
Aug 16 12:15:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-e045b4bf-7060-4f34-adbe-3d0bf0a6621a None None] [instance: 4ace588c-2910-477d-a2f1-259bea336e38] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Acquiring lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG os_brick.utils [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a44770-1b25-4347-8a57-d0e9ebaec55a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[58daf8d0-3bcd-4e01-82ae-27d98d79a6d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc762da-6a3b-4d33-a26e-c53767291090]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1a83a2-4c89-4cd5-8788-40654c5d02be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:15:59 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[223b202c-c277-454c-b393-07f8dd1921c1]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG os_brick.utils [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:59 user nova-compute[73520]: INFO nova.compute.manager [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Swapping volume f66df159-3973-4db8-b857-6b1245c616ad for f43ce2ed-f531-4871-ba93-cbfdb6101e9d
Aug 16 12:15:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-46f1bd15-228b-4a89-a884-4ca50c85a24d req-89c5c2e4-bc26-4b5a-8f49-54a50fc34345 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received event volume-reimaged-f1a466b2-9d08-4a37-9932-1b71914de525 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-46f1bd15-228b-4a89-a884-4ca50c85a24d req-89c5c2e4-bc26-4b5a-8f49-54a50fc34345 service nova] Acquiring lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-46f1bd15-228b-4a89-a884-4ca50c85a24d req-89c5c2e4-bc26-4b5a-8f49-54a50fc34345 service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-46f1bd15-228b-4a89-a884-4ca50c85a24d req-89c5c2e4-bc26-4b5a-8f49-54a50fc34345 service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-46f1bd15-228b-4a89-a884-4ca50c85a24d req-89c5c2e4-bc26-4b5a-8f49-54a50fc34345 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Processing event volume-reimaged-f1a466b2-9d08-4a37-9932-1b71914de525 {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Instance event wait completed in 25 seconds for volume-reimaged {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:15:59 user nova-compute[73520]: INFO nova.virt.block_device [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Booting with volume f1a466b2-9d08-4a37-9932-1b71914de525 at /dev/vda
Aug 16 12:15:59 user nova-compute[73520]: DEBUG os_brick.utils [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6734c8-2b70-4017-a16f-00f8e53e6762]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e028c32-00c2-4214-84d9-f0abe253de31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[701550ae-f759-46d7-bbaf-e2049013db4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b1fbbc-ebb5-49af-b348-5b473a5ac537]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:15:59 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:15:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf79bd5a-767f-4584-a212-f17f61c9bf0a]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG os_brick.utils [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:15:59 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Updating existing volume attachment record: 95d5ac89-cc16-41fd-9f36-69e7568dad3f {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:16:02 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188147.0177994, 1c83f328-2bad-4efa-98f1-2568dcf6a0c3 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:16:02 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] VM Stopped (Lifecycle Event)
Aug 16 12:16:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-eb9fb85e-868e-49b2-b6d3-fafe90215bb7 None None] [instance: 1c83f328-2bad-4efa-98f1-2568dcf6a0c3] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:16:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:16:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:16:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBSMxFPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c1492de2-3545-4ef7-bf3d-07e779d73f8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f43ce2ed-f531-4871-ba93-cbfdb6101e9d', 'serial': 'f43ce2ed-f531-4871-ba93-cbfdb6101e9d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewuIDYNG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'f66df159-3973-4db8-b857-6b1245c616ad'}, 'status': 'reserved', 'instance': 'c1492de2-3545-4ef7-bf3d-07e779d73f8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f66df159-3973-4db8-b857-6b1245c616ad', 'serial'} {{(pid=73520) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBSMxFPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:16:11 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:11 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:11 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d60bbd-ef30-4dc9-a178-5b25ec4d2988]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:16:11 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c39f98-ef7c-4f64-aae7-aaaf724d9e66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d] added
Aug 16 12:16:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbee3a5d-d78f-44ca-b2ff-c6851468ec97]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c9eb00-3645-4b6e-bef2-26463a7f9f5e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBSMxFPq {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBSMxFPq" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[34750b93-9ff0-423d-aba8-c72c8e1abc9d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBSMxFPq'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ca6fe0-800d-4198-aa33-804e98179ca1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8e5836-9344-4819-a2ae-8ae503e6340b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[563ca935-34bb-444c-8c4a-3eee0be60568]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260]
Aug 16 12:16:11 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260] successful.
Aug 16 12:16:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e0ba1b-87f1-42a5-ae17-27bdfb04c2f0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df9d451-ae26-4493-8af7-4e2f2fa0aa1c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:11 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b825dd7-9298-40ad-b992-557efe51f14a]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBSMxFPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:16:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Creating image(s)
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Ensure instance console log exists: /opt/stack/data/nova/instances/2462cd5c-8c3b-49e6-82a9-6539c57edb1e/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Start _get_guest_xml network_info=[{"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfvZMXCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2462cd5c-8c3b-49e6-82a9-6539c57edb1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1a466b2-9d08-4a37-9932-1b71914de525', 'serial': 'f1a466b2-9d08-4a37-9932-1b71914de525'}, 'attachment_id': '95d5ac89-cc16-41fd-9f36-69e7568dad3f', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:16:11 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 12:16:11 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.objects.instance [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2462cd5c-8c3b-49e6-82a9-6539c57edb1e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfvZMXCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:16:11 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 12:16:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26335326239636132', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335326239636132', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.602s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:12 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:12 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lazy-loading 'flavor' on Instance uuid c1492de2-3545-4ef7-bf3d-07e779d73f8d {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd6590c-8b70-4959-a40a-77aab4d1708d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:16:12 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a916b8-9c19-4c63-bdaf-cb1b8154c4d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525] added
Aug 16 12:16:12 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6123c600-c327-470c-bd0a-701173f3bd40]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8ec094-1580-4e8d-81f6-d4c0e6dffad8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfvZMXCI {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfvZMXCI" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdf4119-63a1-465b-ab66-a498887de8d1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zfvZMXCI'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e2ddb4-921c-4b08-9361-a89f8a38c7ca]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35f9d70-f916-4619-b894-3d9adbc32ae3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:12 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:12 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4307f2-57e5-45dc-8112-c1e475055ed9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260]
Aug 16 12:16:12 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260] successful.
Aug 16 12:16:12 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5e7520-cff3-41ba-bebf-ed61c81fdc86]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aba16f4-9907-4cb5-b998-0b1ad7f762d2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:12 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:12 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:12 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] HCTL ('41', '-', '-', 0) found on session 18 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:16:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38c2e70-cb98-4231-b2ed-11bfe5f1d796]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:13 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Searching for a device in session 18 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:16:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfvZMXCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:16:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:16:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 118489088 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.508s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] <== connect_volume: return (2111ms) {'type': 'block', 'scsi_wwn': '26331306536633834', 'path': '/dev/sdj'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331306536633834', 'path': '/dev/sdj'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:13:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1943253361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1649896200',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5lfnNQjk309WHNPoJplqkTWZJCEIgsyDnf1ntfB3MA1o2pn1nFQq7KWgW/Px4t5P3JE58yASksLFE80axLqKjOyguTxIgo/Xo+NW6ip7AMowz4RnKZLCPN8GpS0T7CgA==',key_name='tempest-keypair-280741756',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d27d28a99784c87ae3a67834abbcc38',ramdisk_id='',reservation_id='r-2ozrmaur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-847817773',owner_user_name='tempest-ServerActionsV293TestJSON-847817773-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cabd18e57f6f4859a0e86ab2e4360721',uuid=2462cd5c-8c3b-49e6-82a9-6539c57edb1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Converting VIF {"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:16:14 user nova-compute[73520]:   <uuid>2462cd5c-8c3b-49e6-82a9-6539c57edb1e</uuid>
Aug 16 12:16:14 user nova-compute[73520]:   <name>instance-0000000a</name>
Aug 16 12:16:14 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:16:14 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:16:14 user nova-compute[73520]:   <metadata>
Aug 16 12:16:14 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:16:14 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:16:14 user nova-compute[73520]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1943253361</nova:name>
Aug 16 12:16:14 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:16:11</nova:creationTime>
Aug 16 12:16:14 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:16:14 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:16:14 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:16:14 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:16:14 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:16:14 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:16:14 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:16:14 user nova-compute[73520]:       <nova:owner>
Aug 16 12:16:14 user nova-compute[73520]:         <nova:user uuid="cabd18e57f6f4859a0e86ab2e4360721">tempest-ServerActionsV293TestJSON-847817773-project-member</nova:user>
Aug 16 12:16:14 user nova-compute[73520]:         <nova:project uuid="9d27d28a99784c87ae3a67834abbcc38">tempest-ServerActionsV293TestJSON-847817773</nova:project>
Aug 16 12:16:14 user nova-compute[73520]:       </nova:owner>
Aug 16 12:16:14 user nova-compute[73520]:       <nova:ports>
Aug 16 12:16:14 user nova-compute[73520]:         <nova:port uuid="dbb56176-1321-4be7-b72f-4c2bb0d9f9af">
Aug 16 12:16:14 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 12:16:14 user nova-compute[73520]:         </nova:port>
Aug 16 12:16:14 user nova-compute[73520]:       </nova:ports>
Aug 16 12:16:14 user nova-compute[73520]:     </nova:instance>
Aug 16 12:16:14 user nova-compute[73520]:   </metadata>
Aug 16 12:16:14 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:16:14 user nova-compute[73520]:     <system>
Aug 16 12:16:14 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:16:14 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:16:14 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:16:14 user nova-compute[73520]:       <entry name="serial">2462cd5c-8c3b-49e6-82a9-6539c57edb1e</entry>
Aug 16 12:16:14 user nova-compute[73520]:       <entry name="uuid">2462cd5c-8c3b-49e6-82a9-6539c57edb1e</entry>
Aug 16 12:16:14 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:16:14 user nova-compute[73520]:     </system>
Aug 16 12:16:14 user nova-compute[73520]:   </sysinfo>
Aug 16 12:16:14 user nova-compute[73520]:   <os>
Aug 16 12:16:14 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:16:14 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:16:14 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:16:14 user nova-compute[73520]:   </os>
Aug 16 12:16:14 user nova-compute[73520]:   <features>
Aug 16 12:16:14 user nova-compute[73520]:     <acpi/>
Aug 16 12:16:14 user nova-compute[73520]:     <apic/>
Aug 16 12:16:14 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:16:14 user nova-compute[73520]:   </features>
Aug 16 12:16:14 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:16:14 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:16:14 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:16:14 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:16:14 user nova-compute[73520]:   </clock>
Aug 16 12:16:14 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:16:14 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:16:14 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:16:14 user nova-compute[73520]:   </cpu>
Aug 16 12:16:14 user nova-compute[73520]:   <devices>
Aug 16 12:16:14 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:16:14 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:16:14 user nova-compute[73520]:       <source dev="/dev/sdj"/>
Aug 16 12:16:14 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:16:14 user nova-compute[73520]:       <serial>f1a466b2-9d08-4a37-9932-1b71914de525</serial>
Aug 16 12:16:14 user nova-compute[73520]:     </disk>
Aug 16 12:16:14 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:16:14 user nova-compute[73520]:       <mac address="fa:16:3e:ec:38:f9"/>
Aug 16 12:16:14 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:16:14 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:16:14 user nova-compute[73520]:       <target dev="tapdbb56176-13"/>
Aug 16 12:16:14 user nova-compute[73520]:     </interface>
Aug 16 12:16:14 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:16:14 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/2462cd5c-8c3b-49e6-82a9-6539c57edb1e/console.log" append="off"/>
Aug 16 12:16:14 user nova-compute[73520]:     </serial>
Aug 16 12:16:14 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:16:14 user nova-compute[73520]:     <video>
Aug 16 12:16:14 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:16:14 user nova-compute[73520]:     </video>
Aug 16 12:16:14 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:16:14 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:16:14 user nova-compute[73520]:     </rng>
Aug 16 12:16:14 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:16:14 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:16:14 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:16:14 user nova-compute[73520]:     </memballoon>
Aug 16 12:16:14 user nova-compute[73520]:   </devices>
Aug 16 12:16:14 user nova-compute[73520]: </domain>
Aug 16 12:16:14 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:13:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1943253361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1649896200',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5lfnNQjk309WHNPoJplqkTWZJCEIgsyDnf1ntfB3MA1o2pn1nFQq7KWgW/Px4t5P3JE58yASksLFE80axLqKjOyguTxIgo/Xo+NW6ip7AMowz4RnKZLCPN8GpS0T7CgA==',key_name='tempest-keypair-280741756',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d27d28a99784c87ae3a67834abbcc38',ramdisk_id='',reservation_id='r-2ozrmaur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-847817773',owner_user_name='tempest-ServerActionsV293TestJSON-847817773-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cabd18e57f6f4859a0e86ab2e4360721',uuid=2462cd5c-8c3b-49e6-82a9-6539c57edb1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Converting VIF {"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG os_vif [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbb56176-13, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbb56176-13, col_values=(('external_ids', {'iface-id': 'dbb56176-1321-4be7-b72f-4c2bb0d9f9af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:38:f9', 'vm-uuid': '2462cd5c-8c3b-49e6-82a9-6539c57edb1e'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 247463936 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:14 user nova-compute[73520]: INFO os_vif [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13')
Aug 16 12:16:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] No VIF found with MAC fa:16:3e:ec:38:f9, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:16:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 398458880 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:16:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 534773760 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:16:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 694157312 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:16:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 824180736 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:16:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-2401c6e0-cad0-4606-b05f-10fa1f81156a req-9e9320c6-9cf6-47f6-85e9-962248f1a870 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received event network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2401c6e0-cad0-4606-b05f-10fa1f81156a req-9e9320c6-9cf6-47f6-85e9-962248f1a870 service nova] Acquiring lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2401c6e0-cad0-4606-b05f-10fa1f81156a req-9e9320c6-9cf6-47f6-85e9-962248f1a870 service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2401c6e0-cad0-4606-b05f-10fa1f81156a req-9e9320c6-9cf6-47f6-85e9-962248f1a870 service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-2401c6e0-cad0-4606-b05f-10fa1f81156a req-9e9320c6-9cf6-47f6-85e9-962248f1a870 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] No waiting events found dispatching network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:16 user nova-compute[73520]: WARNING nova.compute.manager [req-2401c6e0-cad0-4606-b05f-10fa1f81156a req-9e9320c6-9cf6-47f6-85e9-962248f1a870 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received unexpected event network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af for instance with vm_state active and task_state rebuild_spawning.
Aug 16 12:16:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 967835648 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:16:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewuIDYNG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'f66df159-3973-4db8-b857-6b1245c616ad'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:16:17 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb42a9a-eaab-4281-9b7f-61698fa9280e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1457dda7-cb12-4cfe-9948-638db184a166]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:17 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:17 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:17 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c7ad3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad'): ({'sdk'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Removing single pathed devices sdk {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff82850f-90ba-40be-9588-ae4b91628147]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eeed25-4357-427d-91e0-6abc97df05a5]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Flushing IO for device /dev/sdk {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa61c15-bb9f-4d8e-a518-54e421b012c0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.038s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e49db3c-90a3-4236-a0cf-1ea084758061]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] SCSI volumes sdk have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b234fee-d6e8-4d05-9393-d6c6e68979f1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6b57ae-6c45-4ab5-bc7b-ffc9ac1ad878]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad, portal: 172.16.0.220,3260]
Aug 16 12:16:17 user nova-compute[73520]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad, portal: 172.16.0.220,3260] successful.
Aug 16 12:16:17 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f66df159-3973-4db8-b857-6b1245c616ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a20281-7a04-4ccb-b9c4-d40cb2feada9]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] <== disconnect_volume: return (360ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBSMxFPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c1492de2-3545-4ef7-bf3d-07e779d73f8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f43ce2ed-f531-4871-ba93-cbfdb6101e9d', 'serial'} {{(pid=73520) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 12:16:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] swap_volume: removing Cinder connection for volume f66df159-3973-4db8-b857-6b1245c616ad {{(pid=73520) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-089bb562-e377-4a43-a676-f1db742e7a8f req-0133336a-44ef-4c49-81bd-a4525e277884 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received event network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-089bb562-e377-4a43-a676-f1db742e7a8f req-0133336a-44ef-4c49-81bd-a4525e277884 service nova] Acquiring lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-089bb562-e377-4a43-a676-f1db742e7a8f req-0133336a-44ef-4c49-81bd-a4525e277884 service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-089bb562-e377-4a43-a676-f1db742e7a8f req-0133336a-44ef-4c49-81bd-a4525e277884 service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-089bb562-e377-4a43-a676-f1db742e7a8f req-0133336a-44ef-4c49-81bd-a4525e277884 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] No waiting events found dispatching network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:18 user nova-compute[73520]: WARNING nova.compute.manager [req-089bb562-e377-4a43-a676-f1db742e7a8f req-0133336a-44ef-4c49-81bd-a4525e277884 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received unexpected event network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af for instance with vm_state active and task_state rebuild_spawning.
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188178.454342, 2462cd5c-8c3b-49e6-82a9-6539c57edb1e => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:16:18 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] VM Resumed (Lifecycle Event)
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:18 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Instance spawned successfully.
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:18 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188178.456214, 2462cd5c-8c3b-49e6-82a9-6539c57edb1e => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:16:18 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] VM Started (Lifecycle Event)
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:16:18 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] swap_volume: Updating volume f66df159-3973-4db8-b857-6b1245c616ad BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "zBSMxFPq", "auth_password": "sZhN9oG8RSAgtP", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "f43ce2ed-f531-4871-ba93-cbfdb6101e9d"}, "status": "reserved", "instance": "c1492de2-3545-4ef7-bf3d-07e779d73f8d", "attached_at": "", "detached_at": "", "volume_id": "f43ce2ed-f531-4871-ba93-cbfdb6101e9d", "serial": "f43ce2ed-f531-4871-ba93-cbfdb6101e9d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f43ce2ed-f531-4871-ba93-cbfdb6101e9d', 'no_device': None, 'attachment_id': '32f55a82-6474-46e9-871f-3d36ab54fb03'} {{(pid=73520) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG nova.objects.instance [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73520) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b60a4904-eeec-449f-a49b-f2dd0061d366 tempest-TestVolumeSwap-1548558146 tempest-TestVolumeSwap-1548558146-project-admin] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.310s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-46f1bd15-228b-4a89-a884-4ca50c85a24d tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.093s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:19 user nova-compute[73520]: INFO nova.compute.manager [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Detaching volume f43ce2ed-f531-4871-ba93-cbfdb6101e9d
Aug 16 12:16:19 user nova-compute[73520]: INFO nova.virt.block_device [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Attempting to driver detach volume f43ce2ed-f531-4871-ba93-cbfdb6101e9d from mountpoint /dev/vdb
Aug 16 12:16:19 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Attempting to detach device vdb from instance c1492de2-3545-4ef7-bf3d-07e779d73f8d from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:16:19 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:16:19 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:16:19 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:16:19 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:16:19 user nova-compute[73520]:   <serial>f43ce2ed-f531-4871-ba93-cbfdb6101e9d</serial>
Aug 16 12:16:19 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:16:19 user nova-compute[73520]: </disk>
Aug 16 12:16:19 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:16:19 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Successfully detached device vdb from instance c1492de2-3545-4ef7-bf3d-07e779d73f8d from the persistent domain config.
Aug 16 12:16:19 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c1492de2-3545-4ef7-bf3d-07e779d73f8d from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:16:19 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:16:19 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:16:19 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:16:19 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:16:19 user nova-compute[73520]:   <serial>f43ce2ed-f531-4871-ba93-cbfdb6101e9d</serial>
Aug 16 12:16:19 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:16:19 user nova-compute[73520]: </disk>
Aug 16 12:16:19 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188180.0545304, c1492de2-3545-4ef7-bf3d-07e779d73f8d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c1492de2-3545-4ef7-bf3d-07e779d73f8d {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:16:20 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Successfully detached device vdb from instance c1492de2-3545-4ef7-bf3d-07e779d73f8d from the live domain config.
Aug 16 12:16:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBSMxFPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'f43ce2ed-f531-4871-ba93-cbfdb6101e9d'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:16:20 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce97878-1519-4328-9f59-01be7d1c9a3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6865f9d-825d-4c46-8b1e-fb687922d2d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:20 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:20 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:20 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c7d4b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6c419a-7354-45e9-bb7a-9db33287e7f5]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[612e237b-7cba-4c0d-a6d2-6460b082ea80]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7700d91d-0786-47e0-b70b-9a4a6c2404fd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f378d21-0d97-4477-b528-21dff4596b87]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4718ed-ba6a-416e-acdb-71779a6ed011]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f34ee9-adec-4c29-99bb-4a95e37c0f7c]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260]
Aug 16 12:16:20 user nova-compute[73520]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d, portal: 172.16.0.220,3260] successful.
Aug 16 12:16:20 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f43ce2ed-f531-4871-ba93-cbfdb6101e9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd18bec-ed1d-4119-a281-b73bff764bd0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] <== disconnect_volume: return (376ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:16:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:16:21 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lazy-loading 'flavor' on Instance uuid c1492de2-3545-4ef7-bf3d-07e779d73f8d {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc1f6226-8562-47ba-8630-d556e4b050a8 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.404s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:23 user nova-compute[73520]: DEBUG nova.objects.instance [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lazy-loading 'flavor' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:24 user nova-compute[73520]: INFO nova.compute.manager [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Attaching volume 4154c7bd-d878-4e40-a992-01e251781ba0 to /dev/vdb
Aug 16 12:16:24 user nova-compute[73520]: DEBUG os_brick.utils [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8235d47-da67-4962-aea0-1f5c25b6e6b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c5194d-8dc3-4089-b31e-72e1e68a622f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdb6fe0-dc33-4e49-a98b-4d9e373a4e13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[81659fad-ccb3-4ce8-9406-3c392fa83b25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:16:24 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5a1af6-00b9-42a6-a3fd-17c9185661bf]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG os_brick.utils [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updating existing volume attachment record: 0b39766b-ca7c-4811-b6a1-863bad0dff25 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG nova.compute.manager [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:24 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:16:24 user nova-compute[73520]: INFO nova.compute.claims [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Claim successful on node user
Aug 16 12:16:24 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.642s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG nova.network.neutron [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:16:25 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:16:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG nova.policy [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb190d4184a94bdd92b148d65dec3956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e448092474d8d85b91b431adf9ee6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:16:25 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Creating image(s)
Aug 16 12:16:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "/opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "/opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.201s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.171s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk 1073741824" returned: 0 in 0.069s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Successfully created port: f1939e02-35f3-40fa-812b-d622a7a64617 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Cannot resize image /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG nova.objects.instance [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lazy-loading 'migration_context' on Instance uuid 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Ensure instance console log exists: /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:26 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:16:26 user nova-compute[73520]: INFO nova.compute.claims [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Claim successful on node user
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.network.neutron [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Successfully updated port: f1939e02-35f3-40fa-812b-d622a7a64617 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-0a05bdd5-3ead-40d0-be3a-a444ba20ee5c req-ac3fcf1a-9bbb-4b28-9f3c-cd5751ecdf28 service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Received event network-changed-f1939e02-35f3-40fa-812b-d622a7a64617 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-0a05bdd5-3ead-40d0-be3a-a444ba20ee5c req-ac3fcf1a-9bbb-4b28-9f3c-cd5751ecdf28 service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Refreshing instance network info cache due to event network-changed-f1939e02-35f3-40fa-812b-d622a7a64617. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0a05bdd5-3ead-40d0-be3a-a444ba20ee5c req-ac3fcf1a-9bbb-4b28-9f3c-cd5751ecdf28 service nova] Acquiring lock "refresh_cache-0ae9104d-5351-4822-a4c2-6bc8e7f2ab35" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0a05bdd5-3ead-40d0-be3a-a444ba20ee5c req-ac3fcf1a-9bbb-4b28-9f3c-cd5751ecdf28 service nova] Acquired lock "refresh_cache-0ae9104d-5351-4822-a4c2-6bc8e7f2ab35" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.network.neutron [req-0a05bdd5-3ead-40d0-be3a-a444ba20ee5c req-ac3fcf1a-9bbb-4b28-9f3c-cd5751ecdf28 service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Refreshing network info cache for port f1939e02-35f3-40fa-812b-d622a7a64617 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "refresh_cache-0ae9104d-5351-4822-a4c2-6bc8e7f2ab35" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.network.neutron [req-0a05bdd5-3ead-40d0-be3a-a444ba20ee5c req-ac3fcf1a-9bbb-4b28-9f3c-cd5751ecdf28 service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.613s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.network.neutron [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:16:27 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.network.neutron [req-0a05bdd5-3ead-40d0-be3a-a444ba20ee5c req-ac3fcf1a-9bbb-4b28-9f3c-cd5751ecdf28 service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0a05bdd5-3ead-40d0-be3a-a444ba20ee5c req-ac3fcf1a-9bbb-4b28-9f3c-cd5751ecdf28 service nova] Releasing lock "refresh_cache-0ae9104d-5351-4822-a4c2-6bc8e7f2ab35" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquired lock "refresh_cache-0ae9104d-5351-4822-a4c2-6bc8e7f2ab35" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.network.neutron [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.policy [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2495e37a99546deb000789aac42ed34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dd566104a645fd8abda43da8d9b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.network.neutron [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:16:27 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Creating image(s)
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "/opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "/opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:16:27 user nova-compute[73520]: DEBUG nova.network.neutron [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Updating instance_info_cache with network_info: [{"id": "f1939e02-35f3-40fa-812b-d622a7a64617", "address": "fa:16:3e:8f:19:54", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1939e02-35", "ovs_interfaceid": "f1939e02-35f3-40fa-812b-d622a7a64617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Releasing lock "refresh_cache-0ae9104d-5351-4822-a4c2-6bc8e7f2ab35" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Instance network_info: |[{"id": "f1939e02-35f3-40fa-812b-d622a7a64617", "address": "fa:16:3e:8f:19:54", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1939e02-35", "ovs_interfaceid": "f1939e02-35f3-40fa-812b-d622a7a64617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Start _get_guest_xml network_info=[{"id": "f1939e02-35f3-40fa-812b-d622a7a64617", "address": "fa:16:3e:8f:19:54", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1939e02-35", "ovs_interfaceid": "f1939e02-35f3-40fa-812b-d622a7a64617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:16:28 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:16:28 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-950633164',display_name='tempest-VolumesAdminNegativeTest-server-950633164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-950633164',id=14,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='380e448092474d8d85b91b431adf9ee6',ramdisk_id='',reservation_id='r-64bz7fr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1985198008',owner_user_name='tempest-VolumesAdminNegativeTest-1985198008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:16:26Z,user_data=None,user_id='fb190d4184a94bdd92b148d65dec3956',uuid=0ae9104d-5351-4822-a4c2-6bc8e7f2ab35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1939e02-35f3-40fa-812b-d622a7a64617", "address": "fa:16:3e:8f:19:54", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1939e02-35", "ovs_interfaceid": "f1939e02-35f3-40fa-812b-d622a7a64617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Converting VIF {"id": "f1939e02-35f3-40fa-812b-d622a7a64617", "address": "fa:16:3e:8f:19:54", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1939e02-35", "ovs_interfaceid": "f1939e02-35f3-40fa-812b-d622a7a64617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:19:54,bridge_name='br-int',has_traffic_filtering=True,id=f1939e02-35f3-40fa-812b-d622a7a64617,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1939e02-35') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.objects.instance [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.245s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:16:28 user nova-compute[73520]:   <uuid>0ae9104d-5351-4822-a4c2-6bc8e7f2ab35</uuid>
Aug 16 12:16:28 user nova-compute[73520]:   <name>instance-0000000e</name>
Aug 16 12:16:28 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:16:28 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:16:28 user nova-compute[73520]:   <metadata>
Aug 16 12:16:28 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:16:28 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:16:28 user nova-compute[73520]:       <nova:name>tempest-VolumesAdminNegativeTest-server-950633164</nova:name>
Aug 16 12:16:28 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:16:28</nova:creationTime>
Aug 16 12:16:28 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:16:28 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:16:28 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:16:28 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:16:28 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:16:28 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:16:28 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:16:28 user nova-compute[73520]:       <nova:owner>
Aug 16 12:16:28 user nova-compute[73520]:         <nova:user uuid="fb190d4184a94bdd92b148d65dec3956">tempest-VolumesAdminNegativeTest-1985198008-project-member</nova:user>
Aug 16 12:16:28 user nova-compute[73520]:         <nova:project uuid="380e448092474d8d85b91b431adf9ee6">tempest-VolumesAdminNegativeTest-1985198008</nova:project>
Aug 16 12:16:28 user nova-compute[73520]:       </nova:owner>
Aug 16 12:16:28 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:16:28 user nova-compute[73520]:       <nova:ports>
Aug 16 12:16:28 user nova-compute[73520]:         <nova:port uuid="f1939e02-35f3-40fa-812b-d622a7a64617">
Aug 16 12:16:28 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 12:16:28 user nova-compute[73520]:         </nova:port>
Aug 16 12:16:28 user nova-compute[73520]:       </nova:ports>
Aug 16 12:16:28 user nova-compute[73520]:     </nova:instance>
Aug 16 12:16:28 user nova-compute[73520]:   </metadata>
Aug 16 12:16:28 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:16:28 user nova-compute[73520]:     <system>
Aug 16 12:16:28 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:16:28 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:16:28 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:16:28 user nova-compute[73520]:       <entry name="serial">0ae9104d-5351-4822-a4c2-6bc8e7f2ab35</entry>
Aug 16 12:16:28 user nova-compute[73520]:       <entry name="uuid">0ae9104d-5351-4822-a4c2-6bc8e7f2ab35</entry>
Aug 16 12:16:28 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:16:28 user nova-compute[73520]:     </system>
Aug 16 12:16:28 user nova-compute[73520]:   </sysinfo>
Aug 16 12:16:28 user nova-compute[73520]:   <os>
Aug 16 12:16:28 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:16:28 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:16:28 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:16:28 user nova-compute[73520]:   </os>
Aug 16 12:16:28 user nova-compute[73520]:   <features>
Aug 16 12:16:28 user nova-compute[73520]:     <acpi/>
Aug 16 12:16:28 user nova-compute[73520]:     <apic/>
Aug 16 12:16:28 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:16:28 user nova-compute[73520]:   </features>
Aug 16 12:16:28 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:16:28 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:16:28 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:16:28 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:16:28 user nova-compute[73520]:   </clock>
Aug 16 12:16:28 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:16:28 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:16:28 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:16:28 user nova-compute[73520]:   </cpu>
Aug 16 12:16:28 user nova-compute[73520]:   <devices>
Aug 16 12:16:28 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:16:28 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:16:28 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk"/>
Aug 16 12:16:28 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:16:28 user nova-compute[73520]:     </disk>
Aug 16 12:16:28 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:16:28 user nova-compute[73520]:       <mac address="fa:16:3e:8f:19:54"/>
Aug 16 12:16:28 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:16:28 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:16:28 user nova-compute[73520]:       <target dev="tapf1939e02-35"/>
Aug 16 12:16:28 user nova-compute[73520]:     </interface>
Aug 16 12:16:28 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:16:28 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/console.log" append="off"/>
Aug 16 12:16:28 user nova-compute[73520]:     </serial>
Aug 16 12:16:28 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:16:28 user nova-compute[73520]:     <video>
Aug 16 12:16:28 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:16:28 user nova-compute[73520]:     </video>
Aug 16 12:16:28 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:16:28 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:16:28 user nova-compute[73520]:     </rng>
Aug 16 12:16:28 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:16:28 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:16:28 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:16:28 user nova-compute[73520]:     </memballoon>
Aug 16 12:16:28 user nova-compute[73520]:   </devices>
Aug 16 12:16:28 user nova-compute[73520]: </domain>
Aug 16 12:16:28 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-950633164',display_name='tempest-VolumesAdminNegativeTest-server-950633164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-950633164',id=14,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='380e448092474d8d85b91b431adf9ee6',ramdisk_id='',reservation_id='r-64bz7fr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1985198008',owner_user_name='tempest-VolumesAdminNegativeTest-1985198008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:16:26Z,user_data=None,user_id='fb190d4184a94bdd92b148d65dec3956',uuid=0ae9104d-5351-4822-a4c2-6bc8e7f2ab35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1939e02-35f3-40fa-812b-d622a7a64617", "address": "fa:16:3e:8f:19:54", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1939e02-35", "ovs_interfaceid": "f1939e02-35f3-40fa-812b-d622a7a64617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Converting VIF {"id": "f1939e02-35f3-40fa-812b-d622a7a64617", "address": "fa:16:3e:8f:19:54", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1939e02-35", "ovs_interfaceid": "f1939e02-35f3-40fa-812b-d622a7a64617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:19:54,bridge_name='br-int',has_traffic_filtering=True,id=f1939e02-35f3-40fa-812b-d622a7a64617,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1939e02-35') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG os_vif [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:19:54,bridge_name='br-int',has_traffic_filtering=True,id=f1939e02-35f3-40fa-812b-d622a7a64617,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1939e02-35') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk 1073741824" returned: 0 in 0.086s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1939e02-35, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1939e02-35, col_values=(('external_ids', {'iface-id': 'f1939e02-35f3-40fa-812b-d622a7a64617', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:19:54', 'vm-uuid': '0ae9104d-5351-4822-a4c2-6bc8e7f2ab35'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:28 user nova-compute[73520]: INFO nova.compute.manager [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Terminating instance
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:28 user nova-compute[73520]: INFO os_vif [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:19:54,bridge_name='br-int',has_traffic_filtering=True,id=f1939e02-35f3-40fa-812b-d622a7a64617,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1939e02-35')
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] No VIF found with MAC fa:16:3e:8f:19:54, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.203s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.network.neutron [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Successfully created port: 27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Cannot resize image /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.objects.instance [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'migration_context' on Instance uuid 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Ensure instance console log exists: /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:28 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-0724864a-7d2e-4e55-8a0c-9c646f9ac40e req-8590dcab-2ab6-4d48-84ff-94f8ce935527 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received event network-vif-unplugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0724864a-7d2e-4e55-8a0c-9c646f9ac40e req-8590dcab-2ab6-4d48-84ff-94f8ce935527 service nova] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0724864a-7d2e-4e55-8a0c-9c646f9ac40e req-8590dcab-2ab6-4d48-84ff-94f8ce935527 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0724864a-7d2e-4e55-8a0c-9c646f9ac40e req-8590dcab-2ab6-4d48-84ff-94f8ce935527 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-0724864a-7d2e-4e55-8a0c-9c646f9ac40e req-8590dcab-2ab6-4d48-84ff-94f8ce935527 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] No waiting events found dispatching network-vif-unplugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-0724864a-7d2e-4e55-8a0c-9c646f9ac40e req-8590dcab-2ab6-4d48-84ff-94f8ce935527 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received event network-vif-unplugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-0724864a-7d2e-4e55-8a0c-9c646f9ac40e req-8590dcab-2ab6-4d48-84ff-94f8ce935527 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received event network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0724864a-7d2e-4e55-8a0c-9c646f9ac40e req-8590dcab-2ab6-4d48-84ff-94f8ce935527 service nova] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0724864a-7d2e-4e55-8a0c-9c646f9ac40e req-8590dcab-2ab6-4d48-84ff-94f8ce935527 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0724864a-7d2e-4e55-8a0c-9c646f9ac40e req-8590dcab-2ab6-4d48-84ff-94f8ce935527 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-0724864a-7d2e-4e55-8a0c-9c646f9ac40e req-8590dcab-2ab6-4d48-84ff-94f8ce935527 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] No waiting events found dispatching network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:29 user nova-compute[73520]: WARNING nova.compute.manager [req-0724864a-7d2e-4e55-8a0c-9c646f9ac40e req-8590dcab-2ab6-4d48-84ff-94f8ce935527 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received unexpected event network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c for instance with vm_state active and task_state deleting.
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.network.neutron [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Successfully updated port: 27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "refresh_cache-5bc17e5d-3ae1-474d-bd49-71c60f3e46be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquired lock "refresh_cache-5bc17e5d-3ae1-474d-bd49-71c60f3e46be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.network.neutron [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-b290df42-4603-488f-9d49-cc8f877f6158 req-0785a907-c08a-4d1d-929b-b1ffc6260d91 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received event network-changed-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-b290df42-4603-488f-9d49-cc8f877f6158 req-0785a907-c08a-4d1d-929b-b1ffc6260d91 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Refreshing instance network info cache due to event network-changed-27a8f0eb-6244-4a6c-81e7-977795d5ea41. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b290df42-4603-488f-9d49-cc8f877f6158 req-0785a907-c08a-4d1d-929b-b1ffc6260d91 service nova] Acquiring lock "refresh_cache-5bc17e5d-3ae1-474d-bd49-71c60f3e46be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.network.neutron [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:16:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Instance destroyed successfully.
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.objects.instance [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lazy-loading 'resources' on Instance uuid 4ce719c9-0210-414f-bbf3-37bfa392125c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1660001176',display_name='tempest-VolumesAssistedSnapshotsTest-server-1660001176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1660001176',id=7,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNUB8K29acWrdDRIOhv2ywmN1na0C9uF/CNyco6X+4iz8wkv5svzXvkhGCmgrrX3HYdcWP1DNRvn2GFuuJmwk5OZ7Bhku0Pp9v8aQXvnKnPkjPf+FI8SEEKVNsHTraAHA==',key_name='tempest-keypair-248214497',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:13:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='caab51add8e64f9686ad8f216d138814',ramdisk_id='',reservation_id='r-0w3c3hqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-357758320',owner_user_name='tempest-VolumesAssistedSnapshotsTest-357758320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99cc5165cef34c4e88e8a5632a032892',uuid=4ce719c9-0210-414f-bbf3-37bfa392125c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "address": "fa:16:3e:1d:41:db", "network": {"id": "ec26c36e-9fe5-4056-8714-2fbb92d9b4cc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-795728958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caab51add8e64f9686ad8f216d138814", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afb34f7-7b", "ovs_interfaceid": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Converting VIF {"id": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "address": "fa:16:3e:1d:41:db", "network": {"id": "ec26c36e-9fe5-4056-8714-2fbb92d9b4cc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-795728958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caab51add8e64f9686ad8f216d138814", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afb34f7-7b", "ovs_interfaceid": "2afb34f7-7b7d-443d-981f-6ef40dd67a0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:41:db,bridge_name='br-int',has_traffic_filtering=True,id=2afb34f7-7b7d-443d-981f-6ef40dd67a0c,network=Network(ec26c36e-9fe5-4056-8714-2fbb92d9b4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afb34f7-7b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG os_vif [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:41:db,bridge_name='br-int',has_traffic_filtering=True,id=2afb34f7-7b7d-443d-981f-6ef40dd67a0c,network=Network(ec26c36e-9fe5-4056-8714-2fbb92d9b4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afb34f7-7b') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2afb34f7-7b, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:29 user nova-compute[73520]: INFO os_vif [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:41:db,bridge_name='br-int',has_traffic_filtering=True,id=2afb34f7-7b7d-443d-981f-6ef40dd67a0c,network=Network(ec26c36e-9fe5-4056-8714-2fbb92d9b4cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afb34f7-7b')
Aug 16 12:16:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Deleting instance files /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c_del
Aug 16 12:16:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Deletion of /opt/stack/data/nova/instances/4ce719c9-0210-414f-bbf3-37bfa392125c_del complete
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:16:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:16:30 user nova-compute[73520]: INFO nova.compute.manager [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Took 1.74 seconds to destroy the instance on the hypervisor.
Aug 16 12:16:30 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.network.neutron [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Updating instance_info_cache with network_info: [{"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Releasing lock "refresh_cache-5bc17e5d-3ae1-474d-bd49-71c60f3e46be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Instance network_info: |[{"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b290df42-4603-488f-9d49-cc8f877f6158 req-0785a907-c08a-4d1d-929b-b1ffc6260d91 service nova] Acquired lock "refresh_cache-5bc17e5d-3ae1-474d-bd49-71c60f3e46be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.network.neutron [req-b290df42-4603-488f-9d49-cc8f877f6158 req-0785a907-c08a-4d1d-929b-b1ffc6260d91 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Refreshing network info cache for port 27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Start _get_guest_xml network_info=[{"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:30 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:16:30 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1602865874',display_name='tempest-tempest.common.compute-instance-1602865874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1602865874',id=15,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWDmy7Y42O8TTQkPPhvFapOqey2yzr7+HunIIo/9lzfe8rKUqepoW4Do3+MfNrt5xHtu6/gJraSlGY+a2w8Nv7CvDCfHvcSHnTbLC47JDVntO2l274nBETm3y7rR4CR0A==',key_name='tempest-keypair-305970178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-lgydxk2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=5bc17e5d-3ae1-474d-bd49-71c60f3e46be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.objects.instance [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:16:30 user nova-compute[73520]:   <uuid>5bc17e5d-3ae1-474d-bd49-71c60f3e46be</uuid>
Aug 16 12:16:30 user nova-compute[73520]:   <name>instance-0000000f</name>
Aug 16 12:16:30 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:16:30 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:16:30 user nova-compute[73520]:   <metadata>
Aug 16 12:16:30 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:16:30 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:16:30 user nova-compute[73520]:       <nova:name>tempest-tempest.common.compute-instance-1602865874</nova:name>
Aug 16 12:16:30 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:16:30</nova:creationTime>
Aug 16 12:16:30 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:16:30 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:16:30 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:16:30 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:16:30 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:16:30 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:16:30 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:16:30 user nova-compute[73520]:       <nova:owner>
Aug 16 12:16:30 user nova-compute[73520]:         <nova:user uuid="d2495e37a99546deb000789aac42ed34">tempest-ServerActionsTestOtherA-294187005-project-member</nova:user>
Aug 16 12:16:30 user nova-compute[73520]:         <nova:project uuid="57dd566104a645fd8abda43da8d9b980">tempest-ServerActionsTestOtherA-294187005</nova:project>
Aug 16 12:16:30 user nova-compute[73520]:       </nova:owner>
Aug 16 12:16:30 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:16:30 user nova-compute[73520]:       <nova:ports>
Aug 16 12:16:30 user nova-compute[73520]:         <nova:port uuid="27a8f0eb-6244-4a6c-81e7-977795d5ea41">
Aug 16 12:16:30 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 12:16:30 user nova-compute[73520]:         </nova:port>
Aug 16 12:16:30 user nova-compute[73520]:       </nova:ports>
Aug 16 12:16:30 user nova-compute[73520]:     </nova:instance>
Aug 16 12:16:30 user nova-compute[73520]:   </metadata>
Aug 16 12:16:30 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:16:30 user nova-compute[73520]:     <system>
Aug 16 12:16:30 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:16:30 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:16:30 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:16:30 user nova-compute[73520]:       <entry name="serial">5bc17e5d-3ae1-474d-bd49-71c60f3e46be</entry>
Aug 16 12:16:30 user nova-compute[73520]:       <entry name="uuid">5bc17e5d-3ae1-474d-bd49-71c60f3e46be</entry>
Aug 16 12:16:30 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:16:30 user nova-compute[73520]:     </system>
Aug 16 12:16:30 user nova-compute[73520]:   </sysinfo>
Aug 16 12:16:30 user nova-compute[73520]:   <os>
Aug 16 12:16:30 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:16:30 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:16:30 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:16:30 user nova-compute[73520]:   </os>
Aug 16 12:16:30 user nova-compute[73520]:   <features>
Aug 16 12:16:30 user nova-compute[73520]:     <acpi/>
Aug 16 12:16:30 user nova-compute[73520]:     <apic/>
Aug 16 12:16:30 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:16:30 user nova-compute[73520]:   </features>
Aug 16 12:16:30 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:16:30 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:16:30 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:16:30 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:16:30 user nova-compute[73520]:   </clock>
Aug 16 12:16:30 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:16:30 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:16:30 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:16:30 user nova-compute[73520]:   </cpu>
Aug 16 12:16:30 user nova-compute[73520]:   <devices>
Aug 16 12:16:30 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:16:30 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:16:30 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk"/>
Aug 16 12:16:30 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:16:30 user nova-compute[73520]:     </disk>
Aug 16 12:16:30 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:16:30 user nova-compute[73520]:       <mac address="fa:16:3e:38:2a:c6"/>
Aug 16 12:16:30 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:16:30 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:16:30 user nova-compute[73520]:       <target dev="tap27a8f0eb-62"/>
Aug 16 12:16:30 user nova-compute[73520]:     </interface>
Aug 16 12:16:30 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:16:30 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/console.log" append="off"/>
Aug 16 12:16:30 user nova-compute[73520]:     </serial>
Aug 16 12:16:30 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:16:30 user nova-compute[73520]:     <video>
Aug 16 12:16:30 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:16:30 user nova-compute[73520]:     </video>
Aug 16 12:16:30 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:16:30 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:16:30 user nova-compute[73520]:     </rng>
Aug 16 12:16:30 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:16:30 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:16:30 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:16:30 user nova-compute[73520]:     </memballoon>
Aug 16 12:16:30 user nova-compute[73520]:   </devices>
Aug 16 12:16:30 user nova-compute[73520]: </domain>
Aug 16 12:16:30 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1602865874',display_name='tempest-tempest.common.compute-instance-1602865874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1602865874',id=15,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWDmy7Y42O8TTQkPPhvFapOqey2yzr7+HunIIo/9lzfe8rKUqepoW4Do3+MfNrt5xHtu6/gJraSlGY+a2w8Nv7CvDCfHvcSHnTbLC47JDVntO2l274nBETm3y7rR4CR0A==',key_name='tempest-keypair-305970178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-lgydxk2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=5bc17e5d-3ae1-474d-bd49-71c60f3e46be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG os_vif [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27a8f0eb-62, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27a8f0eb-62, col_values=(('external_ids', {'iface-id': '27a8f0eb-6244-4a6c-81e7-977795d5ea41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:2a:c6', 'vm-uuid': '5bc17e5d-3ae1-474d-bd49-71c60f3e46be'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:30 user nova-compute[73520]: INFO os_vif [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62')
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No VIF found with MAC fa:16:3e:38:2a:c6, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-2b6f9ba1-342b-43cc-aa2e-ab4726b92465 req-a04b1f2c-48ff-4004-9e90-0ee28f260825 service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Received event network-vif-plugged-f1939e02-35f3-40fa-812b-d622a7a64617 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2b6f9ba1-342b-43cc-aa2e-ab4726b92465 req-a04b1f2c-48ff-4004-9e90-0ee28f260825 service nova] Acquiring lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2b6f9ba1-342b-43cc-aa2e-ab4726b92465 req-a04b1f2c-48ff-4004-9e90-0ee28f260825 service nova] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2b6f9ba1-342b-43cc-aa2e-ab4726b92465 req-a04b1f2c-48ff-4004-9e90-0ee28f260825 service nova] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-2b6f9ba1-342b-43cc-aa2e-ab4726b92465 req-a04b1f2c-48ff-4004-9e90-0ee28f260825 service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] No waiting events found dispatching network-vif-plugged-f1939e02-35f3-40fa-812b-d622a7a64617 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:30 user nova-compute[73520]: WARNING nova.compute.manager [req-2b6f9ba1-342b-43cc-aa2e-ab4726b92465 req-a04b1f2c-48ff-4004-9e90-0ee28f260825 service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Received unexpected event network-vif-plugged-f1939e02-35f3-40fa-812b-d622a7a64617 for instance with vm_state building and task_state spawning.
Aug 16 12:16:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.network.neutron [req-b290df42-4603-488f-9d49-cc8f877f6158 req-0785a907-c08a-4d1d-929b-b1ffc6260d91 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Updated VIF entry in instance network info cache for port 27a8f0eb-6244-4a6c-81e7-977795d5ea41. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG nova.network.neutron [req-b290df42-4603-488f-9d49-cc8f877f6158 req-0785a907-c08a-4d1d-929b-b1ffc6260d91 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Updating instance_info_cache with network_info: [{"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b290df42-4603-488f-9d49-cc8f877f6158 req-0785a907-c08a-4d1d-929b-b1ffc6260d91 service nova] Releasing lock "refresh_cache-5bc17e5d-3ae1-474d-bd49-71c60f3e46be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received event network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] No waiting events found dispatching network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:31 user nova-compute[73520]: WARNING nova.compute.manager [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received unexpected event network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c for instance with vm_state active and task_state deleting.
Aug 16 12:16:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received event network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] No waiting events found dispatching network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:31 user nova-compute[73520]: WARNING nova.compute.manager [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received unexpected event network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c for instance with vm_state active and task_state deleting.
Aug 16 12:16:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received event network-vif-unplugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] No waiting events found dispatching network-vif-unplugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received event network-vif-unplugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received event network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] Acquiring lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] No waiting events found dispatching network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:31 user nova-compute[73520]: WARNING nova.compute.manager [req-c369e4bc-d85f-481b-a4ce-e48aa66503c7 req-54a25c76-8bdf-423e-83a4-e85e616cd533 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received unexpected event network-vif-plugged-2afb34f7-7b7d-443d-981f-6ef40dd67a0c for instance with vm_state active and task_state deleting.
Aug 16 12:16:31 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:31 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Took 1.29 seconds to deallocate network for instance.
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:16:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:32 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Deleted allocations for instance 4ce719c9-0210-414f-bbf3-37bfa392125c
Aug 16 12:16:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8176af43-f6ab-4eeb-b691-ab6bb95610c4 tempest-VolumesAssistedSnapshotsTest-357758320 tempest-VolumesAssistedSnapshotsTest-357758320-project-member] Lock "4ce719c9-0210-414f-bbf3-37bfa392125c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.041s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG nova.compute.manager [req-9f88b983-67df-438c-ad18-f6ea6da00753 req-337ab3b3-6687-436d-852e-20354f8d2139 service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Received event network-vif-plugged-f1939e02-35f3-40fa-812b-d622a7a64617 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9f88b983-67df-438c-ad18-f6ea6da00753 req-337ab3b3-6687-436d-852e-20354f8d2139 service nova] Acquiring lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9f88b983-67df-438c-ad18-f6ea6da00753 req-337ab3b3-6687-436d-852e-20354f8d2139 service nova] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9f88b983-67df-438c-ad18-f6ea6da00753 req-337ab3b3-6687-436d-852e-20354f8d2139 service nova] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG nova.compute.manager [req-9f88b983-67df-438c-ad18-f6ea6da00753 req-337ab3b3-6687-436d-852e-20354f8d2139 service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] No waiting events found dispatching network-vif-plugged-f1939e02-35f3-40fa-812b-d622a7a64617 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:32 user nova-compute[73520]: WARNING nova.compute.manager [req-9f88b983-67df-438c-ad18-f6ea6da00753 req-337ab3b3-6687-436d-852e-20354f8d2139 service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Received unexpected event network-vif-plugged-f1939e02-35f3-40fa-812b-d622a7a64617 for instance with vm_state building and task_state spawning.
Aug 16 12:16:32 user nova-compute[73520]: DEBUG nova.compute.manager [req-9f88b983-67df-438c-ad18-f6ea6da00753 req-337ab3b3-6687-436d-852e-20354f8d2139 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received event network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9f88b983-67df-438c-ad18-f6ea6da00753 req-337ab3b3-6687-436d-852e-20354f8d2139 service nova] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9f88b983-67df-438c-ad18-f6ea6da00753 req-337ab3b3-6687-436d-852e-20354f8d2139 service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9f88b983-67df-438c-ad18-f6ea6da00753 req-337ab3b3-6687-436d-852e-20354f8d2139 service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG nova.compute.manager [req-9f88b983-67df-438c-ad18-f6ea6da00753 req-337ab3b3-6687-436d-852e-20354f8d2139 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] No waiting events found dispatching network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:32 user nova-compute[73520]: WARNING nova.compute.manager [req-9f88b983-67df-438c-ad18-f6ea6da00753 req-337ab3b3-6687-436d-852e-20354f8d2139 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received unexpected event network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 for instance with vm_state building and task_state spawning.
Aug 16 12:16:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:16:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-5706d86c-eaaf-497b-8b18-7e687b16378e req-18ece873-cfc1-4983-8aa1-5bda87f7c746 service nova] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Received event network-vif-deleted-2afb34f7-7b7d-443d-981f-6ef40dd67a0c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188194.3338854, 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:16:34 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] VM Resumed (Lifecycle Event)
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Instance spawned successfully.
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:34 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188194.3343554, 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:16:34 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] VM Started (Lifecycle Event)
Aug 16 12:16:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:16:34 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:16:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:34 user nova-compute[73520]: INFO nova.compute.manager [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Took 9.02 seconds to spawn the instance on the hypervisor.
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.compute.manager [req-cbf81b00-2207-43ad-a083-07e497bf65e4 req-a3bae926-128e-42bd-9a9d-987f83ec100b service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received event network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cbf81b00-2207-43ad-a083-07e497bf65e4 req-a3bae926-128e-42bd-9a9d-987f83ec100b service nova] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cbf81b00-2207-43ad-a083-07e497bf65e4 req-a3bae926-128e-42bd-9a9d-987f83ec100b service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cbf81b00-2207-43ad-a083-07e497bf65e4 req-a3bae926-128e-42bd-9a9d-987f83ec100b service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.compute.manager [req-cbf81b00-2207-43ad-a083-07e497bf65e4 req-a3bae926-128e-42bd-9a9d-987f83ec100b service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] No waiting events found dispatching network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:34 user nova-compute[73520]: WARNING nova.compute.manager [req-cbf81b00-2207-43ad-a083-07e497bf65e4 req-a3bae926-128e-42bd-9a9d-987f83ec100b service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received unexpected event network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 for instance with vm_state building and task_state spawning.
Aug 16 12:16:34 user nova-compute[73520]: INFO nova.compute.manager [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Took 10.06 seconds to build instance.
Aug 16 12:16:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df26f8de-b227-4ea2-ac33-d1ec459fafbf tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.169s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188194.8341014, 5bc17e5d-3ae1-474d-bd49-71c60f3e46be => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:16:34 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] VM Resumed (Lifecycle Event)
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Instance spawned successfully.
Aug 16 12:16:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:16:34 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188194.8342836, 5bc17e5d-3ae1-474d-bd49-71c60f3e46be => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:16:34 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] VM Started (Lifecycle Event)
Aug 16 12:16:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:16:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:16:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:35 user nova-compute[73520]: INFO nova.compute.manager [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Took 7.55 seconds to spawn the instance on the hypervisor.
Aug 16 12:16:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:35 user nova-compute[73520]: INFO nova.compute.manager [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Took 8.68 seconds to build instance.
Aug 16 12:16:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-06ad008c-f465-4bd1-92e1-bc0d47b44010 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.798s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:16:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:16:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:16:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:36 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:16:36 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:16:36 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7320MB free_disk=25.683170318603516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:16:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:16:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:16:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 636510f6-acfa-4705-bfb1-03df3f9297be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:16:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1e35c753-7af1-4047-ad06-8b5755207b8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:16:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance c1492de2-3545-4ef7-bf3d-07e779d73f8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:16:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2462cd5c-8c3b-49e6-82a9-6539c57edb1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:16:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ff7477c9-0c43-4aff-a7c3-e9311c965f40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:16:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d35ff623-3cb2-420f-98c6-9da333fa5cee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:16:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ea9ce4f-479a-42c5-8610-1d1edd06e199 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:16:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:16:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:16:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:16:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:16:38 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:16:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:38 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:16:38 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:16:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.354s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:39 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:16:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:16:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-198a732f-b02f-45f4-a3e9-6e331839aa3d req-b24674d2-90e0-40d9-821b-b62ff84cfa39 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-changed-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-198a732f-b02f-45f4-a3e9-6e331839aa3d req-b24674d2-90e0-40d9-821b-b62ff84cfa39 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing instance network info cache due to event network-changed-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:16:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-198a732f-b02f-45f4-a3e9-6e331839aa3d req-b24674d2-90e0-40d9-821b-b62ff84cfa39 service nova] Acquiring lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:16:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-198a732f-b02f-45f4-a3e9-6e331839aa3d req-b24674d2-90e0-40d9-821b-b62ff84cfa39 service nova] Acquired lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:16:39 user nova-compute[73520]: DEBUG nova.network.neutron [req-198a732f-b02f-45f4-a3e9-6e331839aa3d req-b24674d2-90e0-40d9-821b-b62ff84cfa39 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Refreshing network info cache for port ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:16:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-636510f6-acfa-4705-bfb1-03df3f9297be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:16:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-636510f6-acfa-4705-bfb1-03df3f9297be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:16:40 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:16:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-41f5f538-63b8-4461-acfe-69e4742b710d req-49982dcb-5b51-48a0-8bda-66bfdef858cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-changed-a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-41f5f538-63b8-4461-acfe-69e4742b710d req-49982dcb-5b51-48a0-8bda-66bfdef858cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing instance network info cache due to event network-changed-a17b4d8a-28aa-450d-b11c-6254f52c9cbb. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:16:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-41f5f538-63b8-4461-acfe-69e4742b710d req-49982dcb-5b51-48a0-8bda-66bfdef858cf service nova] Acquiring lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:16:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-41f5f538-63b8-4461-acfe-69e4742b710d req-49982dcb-5b51-48a0-8bda-66bfdef858cf service nova] Acquired lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:16:40 user nova-compute[73520]: DEBUG nova.network.neutron [req-41f5f538-63b8-4461-acfe-69e4742b710d req-49982dcb-5b51-48a0-8bda-66bfdef858cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Refreshing network info cache for port a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:16:40 user nova-compute[73520]: DEBUG nova.network.neutron [req-198a732f-b02f-45f4-a3e9-6e331839aa3d req-b24674d2-90e0-40d9-821b-b62ff84cfa39 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updated VIF entry in instance network info cache for port ae0884bb-d1e5-41f4-82a1-cf1612acc3ef. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:16:40 user nova-compute[73520]: DEBUG nova.network.neutron [req-198a732f-b02f-45f4-a3e9-6e331839aa3d req-b24674d2-90e0-40d9-821b-b62ff84cfa39 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [{"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "address": "fa:16:3e:4a:d3:74", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43824ad0-ef", "ovs_interfaceid": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "address": "fa:16:3e:d7:8c:a9", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60f87c0-2d", "ovs_interfaceid": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-198a732f-b02f-45f4-a3e9-6e331839aa3d req-b24674d2-90e0-40d9-821b-b62ff84cfa39 service nova] Releasing lock "refresh_cache-ff7477c9-0c43-4aff-a7c3-e9311c965f40" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:16:41 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Updating instance_info_cache with network_info: [{"id": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "address": "fa:16:3e:da:67:8e", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8752a2b2-49", "ovs_interfaceid": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-636510f6-acfa-4705-bfb1-03df3f9297be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:16:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:16:41 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:16:41 user nova-compute[73520]: DEBUG nova.network.neutron [req-41f5f538-63b8-4461-acfe-69e4742b710d req-49982dcb-5b51-48a0-8bda-66bfdef858cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updated VIF entry in instance network info cache for port a17b4d8a-28aa-450d-b11c-6254f52c9cbb. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:16:41 user nova-compute[73520]: DEBUG nova.network.neutron [req-41f5f538-63b8-4461-acfe-69e4742b710d req-49982dcb-5b51-48a0-8bda-66bfdef858cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [{"id": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "address": "fa:16:3e:49:3b:e0", "network": {"id": "742c040c-3528-4df9-9028-88841523fc19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1576139447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17b4d8a-28", "ovs_interfaceid": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "address": "fa:16:3e:5c:b7:6c", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48df8bb9-8a", "ovs_interfaceid": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2010228-e41b-4fe6-b814-cfb931b5107a", "address": "fa:16:3e:ed:da:23", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2010228-e4", "ovs_interfaceid": "d2010228-e41b-4fe6-b814-cfb931b5107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-41f5f538-63b8-4461-acfe-69e4742b710d req-49982dcb-5b51-48a0-8bda-66bfdef858cf service nova] Releasing lock "refresh_cache-d35ff623-3cb2-420f-98c6-9da333fa5cee" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDTKFyiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:16:42 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:42 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:42 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0af0e53-1467-415b-82f1-8c40e4a9e984]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:16:42 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a25d31b-6f89-4d9e-8f1c-d86f75bba835]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0] added
Aug 16 12:16:42 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e897ea8-0486-432f-ae0b-56f833e538c3]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff4936f-f48f-45df-bfdb-9b1196140b14]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:42 user nova-compute[73520]: INFO nova.compute.manager [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Terminating instance
Aug 16 12:16:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDTKFyiv {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDTKFyiv" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8f6f62-dff8-4f2d-8466-7f01289fed28]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bDTKFyiv'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e8bd8c-59cc-423d-ba27-a2f7f5933d12]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2a22b5-2d74-4f53-a752-6ea5063cc3a1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:42 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:42 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[345e0ae3-54a4-4a6f-8940-54bdc1b70e80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0, portal: 172.16.0.220,3260]
Aug 16 12:16:42 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0, portal: 172.16.0.220,3260] successful.
Aug 16 12:16:42 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[70851357-e00e-4144-b478-b600bc4f0490]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.060s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7c7360-166a-49ee-bd3b-6d3c4f783ae7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:42 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:42 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:42 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.501s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6da5fd-4d77-47ed-bc84-80c09d889dad]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:16:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDTKFyiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-f8fe4574-2147-4cce-8b07-c7f8c31c0a20 req-93642694-5ffb-4dbe-adbf-eda7f8dc0f01 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f8fe4574-2147-4cce-8b07-c7f8c31c0a20 req-93642694-5ffb-4dbe-adbf-eda7f8dc0f01 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f8fe4574-2147-4cce-8b07-c7f8c31c0a20 req-93642694-5ffb-4dbe-adbf-eda7f8dc0f01 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f8fe4574-2147-4cce-8b07-c7f8c31c0a20 req-93642694-5ffb-4dbe-adbf-eda7f8dc0f01 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-f8fe4574-2147-4cce-8b07-c7f8c31c0a20 req-93642694-5ffb-4dbe-adbf-eda7f8dc0f01 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-unplugged-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-f8fe4574-2147-4cce-8b07-c7f8c31c0a20 req-93642694-5ffb-4dbe-adbf-eda7f8dc0f01 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:43 user nova-compute[73520]: INFO nova.compute.manager [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Terminating instance
Aug 16 12:16:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:43 user nova-compute[73520]: DEBUG nova.compute.manager [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.618s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] <== connect_volume: return (1620ms) {'type': 'block', 'scsi_wwn': '23434643536636264', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434643536636264', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-7b0de9dd-0cee-4e32-b23c-e78af9a8ddc9 req-de78da3d-54f5-4074-8ab4-7b6a249d2e33 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-c60f87c0-2d15-4360-8fa0-bf406fff942d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7b0de9dd-0cee-4e32-b23c-e78af9a8ddc9 req-de78da3d-54f5-4074-8ab4-7b6a249d2e33 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7b0de9dd-0cee-4e32-b23c-e78af9a8ddc9 req-de78da3d-54f5-4074-8ab4-7b6a249d2e33 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7b0de9dd-0cee-4e32-b23c-e78af9a8ddc9 req-de78da3d-54f5-4074-8ab4-7b6a249d2e33 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-7b0de9dd-0cee-4e32-b23c-e78af9a8ddc9 req-de78da3d-54f5-4074-8ab4-7b6a249d2e33 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-unplugged-c60f87c0-2d15-4360-8fa0-bf406fff942d {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-7b0de9dd-0cee-4e32-b23c-e78af9a8ddc9 req-de78da3d-54f5-4074-8ab4-7b6a249d2e33 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-c60f87c0-2d15-4360-8fa0-bf406fff942d for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG nova.objects.instance [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lazy-loading 'flavor' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:16:44 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:16:44 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:16:44 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:16:44 user nova-compute[73520]:   <serial>4154c7bd-d878-4e40-a992-01e251781ba0</serial>
Aug 16 12:16:44 user nova-compute[73520]: </disk>
Aug 16 12:16:44 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-652c89fa-19f8-4348-8a08-ea5402a9b8c4 req-3eeee5a3-4a66-4008-8586-d9400026067f service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-652c89fa-19f8-4348-8a08-ea5402a9b8c4 req-3eeee5a3-4a66-4008-8586-d9400026067f service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-652c89fa-19f8-4348-8a08-ea5402a9b8c4 req-3eeee5a3-4a66-4008-8586-d9400026067f service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-652c89fa-19f8-4348-8a08-ea5402a9b8c4 req-3eeee5a3-4a66-4008-8586-d9400026067f service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-652c89fa-19f8-4348-8a08-ea5402a9b8c4 req-3eeee5a3-4a66-4008-8586-d9400026067f service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-unplugged-a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-652c89fa-19f8-4348-8a08-ea5402a9b8c4 req-3eeee5a3-4a66-4008-8586-d9400026067f service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-a17b4d8a-28aa-450d-b11c-6254f52c9cbb for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188189.8031237, 4ce719c9-0210-414f-bbf3-37bfa392125c => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:16:44 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] VM Stopped (Lifecycle Event)
Aug 16 12:16:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f3c6366b-0e50-461d-99ac-1f6865ef8707 None None] [instance: 4ce719c9-0210-414f-bbf3-37bfa392125c] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:45 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Instance destroyed successfully.
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lazy-loading 'resources' on Instance uuid ff7477c9-0c43-4aff-a7c3-e9311c965f40 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:15:46,bridge_name='br-int',has_traffic_filtering=True,id=ae0884bb-d1e5-41f4-82a1-cf1612acc3ef,network=Network(d4cc21ca-5d96-42cb-99ea-e8ac506baf8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0884bb-d1') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:15:46,bridge_name='br-int',has_traffic_filtering=True,id=ae0884bb-d1e5-41f4-82a1-cf1612acc3ef,network=Network(d4cc21ca-5d96-42cb-99ea-e8ac506baf8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0884bb-d1') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae0884bb-d1, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] No VIF found with MAC fa:16:3e:58:a8:3f, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-f9c8dfc9-a2ee-4b10-8eac-c233ac4b1006 req-ecae9ded-f7a3-4d31-a1d4-66ba7308e8ce service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f9c8dfc9-a2ee-4b10-8eac-c233ac4b1006 req-ecae9ded-f7a3-4d31-a1d4-66ba7308e8ce service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f9c8dfc9-a2ee-4b10-8eac-c233ac4b1006 req-ecae9ded-f7a3-4d31-a1d4-66ba7308e8ce service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f9c8dfc9-a2ee-4b10-8eac-c233ac4b1006 req-ecae9ded-f7a3-4d31-a1d4-66ba7308e8ce service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-f9c8dfc9-a2ee-4b10-8eac-c233ac4b1006 req-ecae9ded-f7a3-4d31-a1d4-66ba7308e8ce service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:45 user nova-compute[73520]: WARNING nova.compute.manager [req-f9c8dfc9-a2ee-4b10-8eac-c233ac4b1006 req-ecae9ded-f7a3-4d31-a1d4-66ba7308e8ce service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef for instance with vm_state active and task_state deleting.
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-f9c8dfc9-a2ee-4b10-8eac-c233ac4b1006 req-ecae9ded-f7a3-4d31-a1d4-66ba7308e8ce service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f9c8dfc9-a2ee-4b10-8eac-c233ac4b1006 req-ecae9ded-f7a3-4d31-a1d4-66ba7308e8ce service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f9c8dfc9-a2ee-4b10-8eac-c233ac4b1006 req-ecae9ded-f7a3-4d31-a1d4-66ba7308e8ce service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f9c8dfc9-a2ee-4b10-8eac-c233ac4b1006 req-ecae9ded-f7a3-4d31-a1d4-66ba7308e8ce service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-f9c8dfc9-a2ee-4b10-8eac-c233ac4b1006 req-ecae9ded-f7a3-4d31-a1d4-66ba7308e8ce service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-unplugged-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-f9c8dfc9-a2ee-4b10-8eac-c233ac4b1006 req-ecae9ded-f7a3-4d31-a1d4-66ba7308e8ce service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1b7f61d-f8ba-499f-b2a5-d49092607549 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.501s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:45 user nova-compute[73520]: INFO os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:15:46,bridge_name='br-int',has_traffic_filtering=True,id=ae0884bb-d1e5-41f4-82a1-cf1612acc3ef,network=Network(d4cc21ca-5d96-42cb-99ea-e8ac506baf8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0884bb-d1')
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=55dedb2f-d7f3-4f2e-bbff-90f53641c5ca,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55dedb2f-d7') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=55dedb2f-d7f3-4f2e-bbff-90f53641c5ca,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55dedb2f-d7') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55dedb2f-d7, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-c60f87c0-2d15-4360-8fa0-bf406fff942d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-c60f87c0-2d15-4360-8fa0-bf406fff942d {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:46 user nova-compute[73520]: WARNING nova.compute.manager [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-c60f87c0-2d15-4360-8fa0-bf406fff942d for instance with vm_state active and task_state deleting.
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-16cf4ff6-8636-43c0-95c6-8cd845011d8f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-unplugged-16cf4ff6-8636-43c0-95c6-8cd845011d8f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-16cf4ff6-8636-43c0-95c6-8cd845011d8f for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-16cf4ff6-8636-43c0-95c6-8cd845011d8f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-16cf4ff6-8636-43c0-95c6-8cd845011d8f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:46 user nova-compute[73520]: WARNING nova.compute.manager [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-16cf4ff6-8636-43c0-95c6-8cd845011d8f for instance with vm_state active and task_state deleting.
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-d2010228-e41b-4fe6-b814-cfb931b5107a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-unplugged-d2010228-e41b-4fe6-b814-cfb931b5107a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-2e89d10b-cc73-4003-8d0d-37f016be4fc0 req-500bab09-031b-46fe-9811-274d96b6beb5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-d2010228-e41b-4fe6-b814-cfb931b5107a for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:46 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Instance destroyed successfully.
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.objects.instance [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lazy-loading 'resources' on Instance uuid d35ff623-3cb2-420f-98c6-9da333fa5cee {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:46 user nova-compute[73520]: INFO os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:aa,bridge_name='br-int',has_traffic_filtering=True,id=55dedb2f-d7f3-4f2e-bbff-90f53641c5ca,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55dedb2f-d7')
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:53:42,bridge_name='br-int',has_traffic_filtering=True,id=a983f522-a453-4636-a051-5780b31b3092,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa983f522-a4') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:53:42,bridge_name='br-int',has_traffic_filtering=True,id=a983f522-a453-4636-a051-5780b31b3092,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa983f522-a4') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa983f522-a4, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "address": "fa:16:3e:49:3b:e0", "network": {"id": "742c040c-3528-4df9-9028-88841523fc19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1576139447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17b4d8a-28", "ovs_interfaceid": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "address": "fa:16:3e:49:3b:e0", "network": {"id": "742c040c-3528-4df9-9028-88841523fc19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1576139447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17b4d8a-28", "ovs_interfaceid": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:3b:e0,bridge_name='br-int',has_traffic_filtering=True,id=a17b4d8a-28aa-450d-b11c-6254f52c9cbb,network=Network(742c040c-3528-4df9-9028-88841523fc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17b4d8a-28') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:3b:e0,bridge_name='br-int',has_traffic_filtering=True,id=a17b4d8a-28aa-450d-b11c-6254f52c9cbb,network=Network(742c040c-3528-4df9-9028-88841523fc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17b4d8a-28') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa17b4d8a-28, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:46 user nova-compute[73520]: INFO os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:53:42,bridge_name='br-int',has_traffic_filtering=True,id=a983f522-a453-4636-a051-5780b31b3092,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa983f522-a4')
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=e289552d-05b7-418b-97c2-7d13c956b3fa,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape289552d-05') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=e289552d-05b7-418b-97c2-7d13c956b3fa,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape289552d-05') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:46 user nova-compute[73520]: WARNING nova.compute.manager [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-a17b4d8a-28aa-450d-b11c-6254f52c9cbb for instance with vm_state active and task_state deleting.
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-unplugged-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:46 user nova-compute[73520]: WARNING nova.compute.manager [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 for instance with vm_state active and task_state deleting.
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-unplugged-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-d7e84294-7cfb-4f80-aaca-53fac67e6901 req-aae04635-4960-4c61-8d1d-99df2056c73b service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape289552d-05, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:46 user nova-compute[73520]: INFO os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:3b:e0,bridge_name='br-int',has_traffic_filtering=True,id=a17b4d8a-28aa-450d-b11c-6254f52c9cbb,network=Network(742c040c-3528-4df9-9028-88841523fc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17b4d8a-28')
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=16cf4ff6-8636-43c0-95c6-8cd845011d8f,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16cf4ff6-86') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=16cf4ff6-8636-43c0-95c6-8cd845011d8f,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16cf4ff6-86') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16cf4ff6-86, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: INFO os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=e289552d-05b7-418b-97c2-7d13c956b3fa,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape289552d-05')
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=2c8f553a-1fb2-4a3b-80dd-0d549112f793,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f553a-1f') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=2c8f553a-1fb2-4a3b-80dd-0d549112f793,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f553a-1f') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:47 user nova-compute[73520]: INFO nova.compute.manager [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Rescuing
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquired lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.neutron [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c8f553a-1f, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:47 user nova-compute[73520]: INFO os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=16cf4ff6-8636-43c0-95c6-8cd845011d8f,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16cf4ff6-86')
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=c775e42a-3c5e-456f-ba77-911c8dc4aa93,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc775e42a-3c') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=c775e42a-3c5e-456f-ba77-911c8dc4aa93,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc775e42a-3c') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc775e42a-3c, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:47 user nova-compute[73520]: INFO os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d4:96,bridge_name='br-int',has_traffic_filtering=True,id=2c8f553a-1fb2-4a3b-80dd-0d549112f793,network=Network(e9d79c29-c4da-4ed6-b448-b2581a6e5f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f553a-1f')
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "address": "fa:16:3e:4a:d3:74", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43824ad0-ef", "ovs_interfaceid": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "address": "fa:16:3e:4a:d3:74", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43824ad0-ef", "ovs_interfaceid": "43824ad0-ef35-4471-9ce5-ffedc9f3784a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=43824ad0-ef35-4471-9ce5-ffedc9f3784a,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43824ad0-ef') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=43824ad0-ef35-4471-9ce5-ffedc9f3784a,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43824ad0-ef') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43824ad0-ef, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:47 user nova-compute[73520]: INFO os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=c775e42a-3c5e-456f-ba77-911c8dc4aa93,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc775e42a-3c')
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "address": "fa:16:3e:5c:b7:6c", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48df8bb9-8a", "ovs_interfaceid": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "address": "fa:16:3e:5c:b7:6c", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48df8bb9-8a", "ovs_interfaceid": "48df8bb9-8a61-49bd-b0b0-7a4b56b87660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b7:6c,bridge_name='br-int',has_traffic_filtering=True,id=48df8bb9-8a61-49bd-b0b0-7a4b56b87660,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48df8bb9-8a') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b7:6c,bridge_name='br-int',has_traffic_filtering=True,id=48df8bb9-8a61-49bd-b0b0-7a4b56b87660,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48df8bb9-8a') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48df8bb9-8a, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:47 user nova-compute[73520]: INFO os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=43824ad0-ef35-4471-9ce5-ffedc9f3784a,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43824ad0-ef')
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1715656529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1715656529',id=12,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLufKjSJwqkaJ3aULZIDihef16j8js24mafj9oe/q3FMB4cvUTukqBskkPUx1dLxN9i+lFQ/dHU0P0xjv9E1isBW4dWEfpKcDdEyeNBWRXPiHnDg1Sy0Mx9zd0Nv3S40Pg==',key_name='tempest-keypair-189353339',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='644147b7898849d188d90d8faf1224c6',ramdisk_id='',reservation_id='r-6md3ij8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-49110099',owner_user_name='tempest-TaggedBootDevicesTest_v242-49110099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48cfae9bca41bbac0fff658bf6cdbc',uuid=ff7477c9-0c43-4aff-a7c3-e9311c965f40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "address": "fa:16:3e:d7:8c:a9", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60f87c0-2d", "ovs_interfaceid": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converting VIF {"id": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "address": "fa:16:3e:d7:8c:a9", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60f87c0-2d", "ovs_interfaceid": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:8c:a9,bridge_name='br-int',has_traffic_filtering=True,id=c60f87c0-2d15-4360-8fa0-bf406fff942d,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60f87c0-2d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:8c:a9,bridge_name='br-int',has_traffic_filtering=True,id=c60f87c0-2d15-4360-8fa0-bf406fff942d,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60f87c0-2d') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc60f87c0-2d, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:47 user nova-compute[73520]: INFO os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b7:6c,bridge_name='br-int',has_traffic_filtering=True,id=48df8bb9-8a61-49bd-b0b0-7a4b56b87660,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48df8bb9-8a')
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2010228-e41b-4fe6-b814-cfb931b5107a", "address": "fa:16:3e:ed:da:23", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2010228-e4", "ovs_interfaceid": "d2010228-e41b-4fe6-b814-cfb931b5107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "d2010228-e41b-4fe6-b814-cfb931b5107a", "address": "fa:16:3e:ed:da:23", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2010228-e4", "ovs_interfaceid": "d2010228-e41b-4fe6-b814-cfb931b5107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:da:23,bridge_name='br-int',has_traffic_filtering=True,id=d2010228-e41b-4fe6-b814-cfb931b5107a,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2010228-e4') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:da:23,bridge_name='br-int',has_traffic_filtering=True,id=d2010228-e41b-4fe6-b814-cfb931b5107a,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2010228-e4') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2010228-e4, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:47 user nova-compute[73520]: INFO os_vif [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:8c:a9,bridge_name='br-int',has_traffic_filtering=True,id=c60f87c0-2d15-4360-8fa0-bf406fff942d,network=Network(3cb0c534-8d1e-4a4c-bc75-9313c99b46ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60f87c0-2d')
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swuZPcDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:16:47 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:47 user nova-compute[73520]: INFO os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:da:23,bridge_name='br-int',has_traffic_filtering=True,id=d2010228-e41b-4fe6-b814-cfb931b5107a,network=Network(b0956d4b-05a5-413d-b603-bb6557b2f4f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2010228-e4')
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=ee409ffe-08fa-490f-ab00-0c107a83ad39,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee409ffe-08') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=ee409ffe-08fa-490f-ab00-0c107a83ad39,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee409ffe-08') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:47 user nova-compute[73520]: WARNING nova.compute.manager [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-55dedb2f-d7f3-4f2e-bbff-90f53641c5ca for instance with vm_state active and task_state deleting.
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-a983f522-a453-4636-a051-5780b31b3092 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-unplugged-a983f522-a453-4636-a051-5780b31b3092 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-a983f522-a453-4636-a051-5780b31b3092 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-a983f522-a453-4636-a051-5780b31b3092 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-a983f522-a453-4636-a051-5780b31b3092 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:47 user nova-compute[73520]: WARNING nova.compute.manager [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-a983f522-a453-4636-a051-5780b31b3092 for instance with vm_state active and task_state deleting.
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-e289552d-05b7-418b-97c2-7d13c956b3fa {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-unplugged-e289552d-05b7-418b-97c2-7d13c956b3fa {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-6c3c9a71-95a3-42a6-9e44-8c4159b40aae req-cb5fa162-f157-4eac-966b-0dba1d819817 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-e289552d-05b7-418b-97c2-7d13c956b3fa for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c9e495-c0d2-4f1c-a63a-f0ab4996fac4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee409ffe-08, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: INFO os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c5:c8,bridge_name='br-int',has_traffic_filtering=True,id=ee409ffe-08fa-490f-ab00-0c107a83ad39,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee409ffe-08')
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1465012288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1465012288',id=11,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbHYqPMBO1GjLafuzMEU+qCK4YnY1phFex1ldDwbonWTScu0DznecxLPXedKD2ljSm5nHVrG839rWSi1EYGEFndK4WfxBorc17Zv6BN4avEoNac9x4fYHZblK3uZrmJjA==',key_name='tempest-keypair-1014992861',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e591da95a84cb0b3c2e42ff63b13ae',ramdisk_id='',reservation_id='r-0z8zb07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1030514499',owner_user_name='tempest-TaggedBootDevicesTest-1030514499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2f6368a69254d3fa9b4d8e9f725569c',uuid=d35ff623-3cb2-420f-98c6-9da333fa5cee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converting VIF {"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d2be9b32-5339-4e58-abd1-02cf8c09b9e2,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9b32-53') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d2be9b32-5339-4e58-abd1-02cf8c09b9e2,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9b32-53') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2be9b32-53, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:47 user nova-compute[73520]: INFO os_vif [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2e:9e,bridge_name='br-int',has_traffic_filtering=True,id=d2be9b32-5339-4e58-abd1-02cf8c09b9e2,network=Network(feeb920d-42cd-4e3a-b056-9e839d6622c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9b32-53')
Aug 16 12:16:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtwTAFxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:16:47 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.061s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc99496-fe27-433d-81d0-fc5cf5aec8fb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:47 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:47 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:47 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c758b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add'): ({'sdi'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Removing single pathed devices sdi {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed5ed89-be11-49b6-9204-a0b54cab4027]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c6a34d-e5df-454b-a6c4-6c522f2523cd]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Flushing IO for device /dev/sdi {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[462f9ca8-aa69-483e-9dd1-d261e4968127]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dd6f7f-b81e-49cd-92bc-63dd3b7b9dcd]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] SCSI volumes sdi have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[258e521c-ddf2-4c85-98a6-c19ec2ade8d6]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[010997a7-c443-49db-961f-99e9d0d4f783]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add, portal: 172.16.0.220,3260]
Aug 16 12:16:48 user nova-compute[73520]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add, portal: 172.16.0.220,3260] successful.
Aug 16 12:16:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ca61a09-f1a6-438d-b4ef-2ca571993add -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[44df4f18-ed6a-4cb2-beb7-92cd8b9ee55f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] <== disconnect_volume: return (450ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.350s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCJNnjYP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:16:48 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[db75b889-6902-4615-9e86-1ca0eb8e3e0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05644a0-e4e1-431f-9231-8b62066824c0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c7e6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af'): ({'sdf'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Removing single pathed devices sdf {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ecead1-9745-48fb-bfe7-e72d6c54a8cb]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f86b9e-06ad-4747-8efc-660590058d8e]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Flushing IO for device /dev/sdf {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.network.neutron [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updating instance_info_cache with network_info: [{"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a3c1da-0354-4381-b2e1-7b8685d0a73f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Releasing lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3156415b-26df-442a-b416-4efe2d92bd0c]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] SCSI volumes sdf have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-d2010228-e41b-4fe6-b814-cfb931b5107a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-d2010228-e41b-4fe6-b814-cfb931b5107a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:48 user nova-compute[73520]: WARNING nova.compute.manager [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-d2010228-e41b-4fe6-b814-cfb931b5107a for instance with vm_state active and task_state deleting.
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-ee409ffe-08fa-490f-ab00-0c107a83ad39 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-unplugged-ee409ffe-08fa-490f-ab00-0c107a83ad39 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-ee409ffe-08fa-490f-ab00-0c107a83ad39 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-ee409ffe-08fa-490f-ab00-0c107a83ad39 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-ee409ffe-08fa-490f-ab00-0c107a83ad39 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:48 user nova-compute[73520]: WARNING nova.compute.manager [req-07c7871e-8028-447b-81d0-56a9d5dfa025 req-eb25ea66-5799-486a-a837-0ddbb24266cf service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-ee409ffe-08fa-490f-ab00-0c107a83ad39 for instance with vm_state active and task_state deleting.
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[975b6d23-09ed-48c1-9bc6-6c1b5b75a405]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6789147-9181-4973-a85a-47cab7ad601c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af, portal: 172.16.0.220,3260]
Aug 16 12:16:48 user nova-compute[73520]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af, portal: 172.16.0.220,3260] successful.
Aug 16 12:16:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:808e06ad-7957-4b4b-8a54-17dc3b0108af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.100s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1050d498-1838-44f9-90de-e64add6ff350]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.501s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] <== disconnect_volume: return (850ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.497s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKgnkxvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:16:48 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7482952e-e238-426a-9583-0834de208989]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[810e9f8b-f4ed-4e1d-b0e2-4927dcfaba8b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:48 user nova-compute[73520]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 (non-flash)
Aug 16 12:16:48 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c7d4b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9'): ({'sdh'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Removing single pathed devices sdh {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca377dc3-6a85-4633-abe6-c102c5cc14cf]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.044s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dd4d17-cfd8-4499-9dc7-2ff0758b2357]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Flushing IO for device /dev/sdh {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c886e662-9fc2-4700-b778-324e19d08dfe]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.070s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f860222-1ca4-4778-804a-0f37de800d9b]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] SCSI volumes sdh have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-486da6cd-4815-4903-8238-fbb0e6199e8d req-8beb1308-999c-44e2-a706-b0f07c913c53 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-486da6cd-4815-4903-8238-fbb0e6199e8d req-8beb1308-999c-44e2-a706-b0f07c913c53 service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-486da6cd-4815-4903-8238-fbb0e6199e8d req-8beb1308-999c-44e2-a706-b0f07c913c53 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-486da6cd-4815-4903-8238-fbb0e6199e8d req-8beb1308-999c-44e2-a706-b0f07c913c53 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-486da6cd-4815-4903-8238-fbb0e6199e8d req-8beb1308-999c-44e2-a706-b0f07c913c53 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:48 user nova-compute[73520]: WARNING nova.compute.manager [req-486da6cd-4815-4903-8238-fbb0e6199e8d req-8beb1308-999c-44e2-a706-b0f07c913c53 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 for instance with vm_state active and task_state deleting.
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dc0939-e0b1-4c91-96ad-6728e8999480]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.104s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdfcda6-d051-4bfd-9fa1-997aea329187]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9, portal: 172.16.0.220,3260]
Aug 16 12:16:49 user nova-compute[73520]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9, portal: 172.16.0.220,3260] successful.
Aug 16 12:16:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5480195e-373a-4385-af13-1c5c8401ded9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[329fcbdc-436e-445e-bc75-a105a93e3bb1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.492s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] <== disconnect_volume: return (990ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.488s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTWCPGic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:16:49 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.039s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2e8ec5-e71c-4aed-a2cd-3c6b585d7477]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec8d500-58b7-4e03-847c-18d62dd26bee]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:49 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:49 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:49 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:49 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:49 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:49 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:49 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:49 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:49 user nova-compute[73520]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a (non-flash)
Aug 16 12:16:49 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c34c310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a'): ({'sde'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Removing single pathed devices sde {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c89c6f6-169e-4fce-9eb7-c9488f9c7ce1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:49 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Instance destroyed successfully.
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.036s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d79b8db-c1b8-421b-9e0c-a51d3e9b6c83]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Flushing IO for device /dev/sde {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:16:49 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Attempting a stable device rescue
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.036s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a06adfe-b09a-4e53-a3d4-8075cabaae50]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73520) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Instance directory exists: not creating {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 12:16:49 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Creating image(s)
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "/opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "/opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c415f0d4-be2e-4667-91a4-78d36a71fc56]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "a4562045ae7837725180bf8cfa3177f4e007537c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "a4562045ae7837725180bf8cfa3177f4e007537c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[673f447d-f0d6-4064-8abb-7c67decfd5d8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[687d1f9b-15a4-41eb-9804-20762a95db1b]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a, portal: 172.16.0.220,3260]
Aug 16 12:16:49 user nova-compute[73520]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a, portal: 172.16.0.220,3260] successful.
Aug 16 12:16:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c.part --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12dc311-b21c-47af-84b7-1d5dc129e45a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea14581-e1d8-4aa3-ad16-2ed6b1d24e26]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-e289552d-05b7-418b-97c2-7d13c956b3fa {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-e289552d-05b7-418b-97c2-7d13c956b3fa {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:50 user nova-compute[73520]: WARNING nova.compute.manager [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-e289552d-05b7-418b-97c2-7d13c956b3fa for instance with vm_state active and task_state deleting.
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-2c8f553a-1fb2-4a3b-80dd-0d549112f793 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-unplugged-2c8f553a-1fb2-4a3b-80dd-0d549112f793 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-2c8f553a-1fb2-4a3b-80dd-0d549112f793 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-2c8f553a-1fb2-4a3b-80dd-0d549112f793 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-2c8f553a-1fb2-4a3b-80dd-0d549112f793 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:50 user nova-compute[73520]: WARNING nova.compute.manager [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-2c8f553a-1fb2-4a3b-80dd-0d549112f793 for instance with vm_state active and task_state deleting.
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-43824ad0-ef35-4471-9ce5-ffedc9f3784a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-unplugged-43824ad0-ef35-4471-9ce5-ffedc9f3784a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-53a2eed5-1d5c-47bc-a8a8-8e64ca88c0e5 req-83e2b94f-4ceb-45a1-bdcd-0eef5a62dacd service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-unplugged-43824ad0-ef35-4471-9ce5-ffedc9f3784a for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-62621384-eddd-4fb3-8da9-e1d032e45ebb req-b4674641-ec3e-4f78-a986-98ad34503e30 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-unplugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62621384-eddd-4fb3-8da9-e1d032e45ebb req-b4674641-ec3e-4f78-a986-98ad34503e30 service nova] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62621384-eddd-4fb3-8da9-e1d032e45ebb req-b4674641-ec3e-4f78-a986-98ad34503e30 service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62621384-eddd-4fb3-8da9-e1d032e45ebb req-b4674641-ec3e-4f78-a986-98ad34503e30 service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-62621384-eddd-4fb3-8da9-e1d032e45ebb req-b4674641-ec3e-4f78-a986-98ad34503e30 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] No waiting events found dispatching network-vif-unplugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:50 user nova-compute[73520]: WARNING nova.compute.manager [req-62621384-eddd-4fb3-8da9-e1d032e45ebb req-b4674641-ec3e-4f78-a986-98ad34503e30 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received unexpected event network-vif-unplugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 for instance with vm_state active and task_state rescuing.
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-62621384-eddd-4fb3-8da9-e1d032e45ebb req-b4674641-ec3e-4f78-a986-98ad34503e30 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62621384-eddd-4fb3-8da9-e1d032e45ebb req-b4674641-ec3e-4f78-a986-98ad34503e30 service nova] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62621384-eddd-4fb3-8da9-e1d032e45ebb req-b4674641-ec3e-4f78-a986-98ad34503e30 service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62621384-eddd-4fb3-8da9-e1d032e45ebb req-b4674641-ec3e-4f78-a986-98ad34503e30 service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-62621384-eddd-4fb3-8da9-e1d032e45ebb req-b4674641-ec3e-4f78-a986-98ad34503e30 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] No waiting events found dispatching network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:50 user nova-compute[73520]: WARNING nova.compute.manager [req-62621384-eddd-4fb3-8da9-e1d032e45ebb req-b4674641-ec3e-4f78-a986-98ad34503e30 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received unexpected event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 for instance with vm_state active and task_state rescuing.
Aug 16 12:16:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.848s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] <== disconnect_volume: return (2336ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.839s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWRFymLf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:16:51 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[350aee1e-2e06-4279-8629-09effbee613f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3611312d-e703-48bd-a828-b308363ed90f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:51 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad (non-flash)
Aug 16 12:16:51 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c7e57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad'): ({'sdg'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Removing single pathed devices sdg {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-1e723c5b-eff8-4706-bce0-812c5e9e053b req-b195b25f-d963-4c33-85f9-a68aefd37875 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Received event network-changed-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-1e723c5b-eff8-4706-bce0-812c5e9e053b req-b195b25f-d963-4c33-85f9-a68aefd37875 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Refreshing instance network info cache due to event network-changed-b9b63116-58c8-40ee-81cd-cf03d0f2ec88. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1e723c5b-eff8-4706-bce0-812c5e9e053b req-b195b25f-d963-4c33-85f9-a68aefd37875 service nova] Acquiring lock "refresh_cache-6ea9ce4f-479a-42c5-8610-1d1edd06e199" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1e723c5b-eff8-4706-bce0-812c5e9e053b req-b195b25f-d963-4c33-85f9-a68aefd37875 service nova] Acquired lock "refresh_cache-6ea9ce4f-479a-42c5-8610-1d1edd06e199" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.network.neutron [req-1e723c5b-eff8-4706-bce0-812c5e9e053b req-b195b25f-d963-4c33-85f9-a68aefd37875 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Refreshing network info cache for port b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[15119a5f-ee58-4fcb-9736-81525497ff1e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c.part --force-share --output=json" returned: 0 in 0.241s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.virt.images [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] 63361535-42fc-45bc-ae96-e783c45b9a31 was qcow2, converting to raw {{(pid=73520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c.part /opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c.converted {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.036s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0643a2cb-f868-4bd1-93c6-2b3f9bb376d8]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Flushing IO for device /dev/sdg {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.041s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abbef66-f900-4699-a863-2df361e609d1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.144s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ddde76-c53e-45a2-87bf-cc6e508a0feb]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] SCSI volumes sdg have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ae4873-209c-4f1d-b90d-1e928e6ba93a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:51 user nova-compute[73520]: INFO nova.compute.manager [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Terminating instance
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.123s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c33276-ef9b-4874-8d4f-8269bc243f8e]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad, portal: 172.16.0.220,3260]
Aug 16 12:16:51 user nova-compute[73520]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad, portal: 172.16.0.220,3260] successful.
Aug 16 12:16:51 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0318da1-09d3-4916-a9fb-8168456b93ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfa4c12-d6e0-4b65-961c-f169113039bf]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.599s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] <== disconnect_volume: return (2438ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:16:51 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Deleting instance files /opt/stack/data/nova/instances/ff7477c9-0c43-4aff-a7c3-e9311c965f40_del
Aug 16 12:16:51 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Deletion of /opt/stack/data/nova/instances/ff7477c9-0c43-4aff-a7c3-e9311c965f40_del complete
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.590s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[83412cc2-2d96-46e3-bbfb-a78fa0c0edca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c.part /opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c.converted" returned: 0 in 0.525s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c.converted --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6325af73-9c7d-4d30-9ad5-56b2783f5372]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:51 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:51 user nova-compute[73520]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc (non-flash)
Aug 16 12:16:51 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c11cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc'): ({'sdd'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Removing single pathed devices sdd {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: INFO nova.compute.manager [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Took 9.28 seconds to destroy the instance on the hypervisor.
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[583a51a8-e95f-4635-aaab-9ff89e9f7b03]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab6776-007a-4c7d-ba31-1c17a4255acc]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Flushing IO for device /dev/sdd {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-plugged-43824ad0-ef35-4471-9ce5-ffedc9f3784a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] Acquiring lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] No waiting events found dispatching network-vif-plugged-43824ad0-ef35-4471-9ce5-ffedc9f3784a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:51 user nova-compute[73520]: WARNING nova.compute.manager [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received unexpected event network-vif-plugged-43824ad0-ef35-4471-9ce5-ffedc9f3784a for instance with vm_state active and task_state deleting.
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-c775e42a-3c5e-456f-ba77-911c8dc4aa93 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-unplugged-c775e42a-3c5e-456f-ba77-911c8dc4aa93 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-unplugged-c775e42a-3c5e-456f-ba77-911c8dc4aa93 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-plugged-c775e42a-3c5e-456f-ba77-911c8dc4aa93 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] Acquiring lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] No waiting events found dispatching network-vif-plugged-c775e42a-3c5e-456f-ba77-911c8dc4aa93 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:51 user nova-compute[73520]: WARNING nova.compute.manager [req-62d567dc-4d7a-4e5b-8997-5021a455392a req-172befd1-de22-45a7-96f2-e473ee186c09 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received unexpected event network-vif-plugged-c775e42a-3c5e-456f-ba77-911c8dc4aa93 for instance with vm_state active and task_state deleting.
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3073c990-273d-4d9d-b7a6-4944db0b6cbc]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[30217398-c019-4036-ab07-18adb00c71cb]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] SCSI volumes sdd have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c.converted --force-share --output=json" returned: 0 in 0.266s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "a4562045ae7837725180bf8cfa3177f4e007537c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.532s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "a4562045ae7837725180bf8cfa3177f4e007537c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "a4562045ae7837725180bf8cfa3177f4e007537c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[084d677e-6516-4a6e-86ba-35c30d93b02a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fb0d10-67f9-4b4b-b5ee-a571c7984d7c]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc, portal: 172.16.0.220,3260]
Aug 16 12:16:52 user nova-compute[73520]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc, portal: 172.16.0.220,3260] successful.
Aug 16 12:16:52 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21b2a79-9685-465d-8aa3-a36c978d53dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8a0970-cf67-4593-92a3-bd69b6a33033]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.549s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] <== disconnect_volume: return (1139ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:16:52 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Deleting instance files /opt/stack/data/nova/instances/d35ff623-3cb2-420f-98c6-9da333fa5cee_del
Aug 16 12:16:52 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Deletion of /opt/stack/data/nova/instances/d35ff623-3cb2-420f-98c6-9da333fa5cee_del complete
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c --force-share --output=json" returned: 0 in 0.213s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c,backing_fmt=raw /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.rescue {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:52 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Instance destroyed successfully.
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'resources' on Instance uuid 6ea9ce4f-479a-42c5-8610-1d1edd06e199 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c,backing_fmt=raw /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.rescue" returned: 0 in 0.099s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "a4562045ae7837725180bf8cfa3177f4e007537c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lazy-loading 'migration_context' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-482985637',display_name='tempest-AttachVolumeNegativeTest-server-482985637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-482985637',id=13,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjAz5eFoacIb5n427h8AghyOoy4cW2jn/qT+ECphwo5zcoxilDcnQRN7rBOaco0lfRlWonvZ6vKXZ3bjKvZTRZGAXym8bA1Q9WB3L7UhZtPJ7UISnXifJtg5Z+41S2a5w==',key_name='tempest-keypair-1148098543',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1059841e2ee04ca4870497a1ec60bcaa',ramdisk_id='',reservation_id='r-xq2chp7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1618912538',owner_user_name='tempest-AttachVolumeNegativeTest-1618912538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6426c917725745038fdb1d03fec4a2fd',uuid=6ea9ce4f-479a-42c5-8610-1d1edd06e199,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "address": "fa:16:3e:07:c9:d0", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b63116-58", "ovs_interfaceid": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converting VIF {"id": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "address": "fa:16:3e:07:c9:d0", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b63116-58", "ovs_interfaceid": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=b9b63116-58c8-40ee-81cd-cf03d0f2ec88,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b63116-58') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_vif [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=b9b63116-58c8-40ee-81cd-cf03d0f2ec88,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b63116-58') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9b63116-58, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Start _get_guest_xml network_info=[{"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "vif_mac": "fa:16:3e:58:a8:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '63361535-42fc-45bc-ae96-e783c45b9a31', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDTKFyiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2a72dbe6-dfc2-4527-8213-c2e9fe2f553a', 'attached_at': '', 'detached_at': '', 'volume_id': '4154c7bd-d878-4e40-a992-01e251781ba0', 'serial': '4154c7bd-d878-4e40-a992-01e251781ba0'}, 'attachment_id': '0b39766b-ca7c-4811-b6a1-863bad0dff25', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lazy-loading 'resources' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lazy-loading 'numa_topology' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:52 user nova-compute[73520]: INFO os_vif [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c9:d0,bridge_name='br-int',has_traffic_filtering=True,id=b9b63116-58c8-40ee-81cd-cf03d0f2ec88,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b63116-58')
Aug 16 12:16:52 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Deleting instance files /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199_del
Aug 16 12:16:52 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Deletion of /opt/stack/data/nova/instances/6ea9ce4f-479a-42c5-8610-1d1edd06e199_del complete
Aug 16 12:16:52 user nova-compute[73520]: INFO nova.compute.manager [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Took 8.45 seconds to destroy the instance on the hypervisor.
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:16:52 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:16:52 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDTKFyiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:16:52 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:52 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:16:52 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:52 user nova-compute[73520]: INFO nova.compute.manager [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f05d47-ac78-4829-8239-c1264df356dc]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = bDTKFyiv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 12:16:52 user nova-compute[73520]: node.name = iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0
Aug 16 12:16:52 user nova-compute[73520]: node.tpgt = -1
Aug 16 12:16:52 user nova-compute[73520]: node.startup = automatic
Aug 16 12:16:52 user nova-compute[73520]: node.leading_login = No
Aug 16 12:16:52 user nova-compute[73520]: iface.iscsi_ifacename = default
Aug 16 12:16:52 user nova-compute[73520]: iface.net_ifacename = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.ipaddress = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.prefix_len = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.hwaddress = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.transport_name = tcp
Aug 16 12:16:52 user nova-compute[73520]: iface.initiatorname = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.state = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.vlan_id = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.vlan_priority = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.vlan_state = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.iface_num = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.mtu = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.port = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.bootproto = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.subnet_mask = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.gateway = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.dhcp_alt_client_id = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.dhcp_dns = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.dhcp_learn_iqn = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.dhcp_vendor_id_state = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.dhcp_vendor_id = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.dhcp_slp_da = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.fragmentation = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.gratuitous_arp = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.incoming_forwarding = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.tos_state = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.tos = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.ttl = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.delayed_ack = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.tcp_nagle = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.tcp_wsf_state = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.tcp_wsf = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.tcp_timer_scale = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.tcp_timestamp = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.redirect = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.def_task_mgmt_timeout = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.header_digest = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.data_digest = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.immediate_data = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.initial_r2t = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.data_seq_inorder = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.data_pdu_inorder = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.erl = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.max_receive_data_len = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.first_burst_len = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.max_outstanding_r2t = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.max_burst_len = 0
Aug 16 12:16:52 user nova-compute[73520]: iface.chap_auth = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.bidi_chap = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.strict_login_compliance = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.discovery_auth = <empty>
Aug 16 12:16:52 user nova-compute[73520]: iface.discovery_logout = <empty>
Aug 16 12:16:52 user nova-compute[73520]: node.discovery_address = <empty>
Aug 16 12:16:52 user nova-compute[73520]: node.discovery_port = 0
Aug 16 12:16:52 user nova-compute[73520]: node.discovery_type = static
Aug 16 12:16:52 user nova-compute[73520]: node.session.initial_cmdsn = 0
Aug 16 12:16:52 user nova-compute[73520]: node.session.initial_login_retry_max = 8
Aug 16 12:16:52 user nova-compute[73520]: node.session.xmit_thread_priority = -20
Aug 16 12:16:52 user nova-compute[73520]: node.session.cmds_max = 128
Aug 16 12:16:52 user nova-compute[73520]: node.session.queue_depth = 32
Aug 16 12:16:52 user nova-compute[73520]: node.session.nr_sessions = 1
Aug 16 12:16:52 user nova-compute[73520]: node.session.auth.authmethod = CHAP
Aug 16 12:16:52 user nova-compute[73520]: node.session.auth.username = bDTKFyiv
Aug 16 12:16:52 user nova-compute[73520]: node.session.auth.password = ***
Aug 16 12:16:52 user nova-compute[73520]: node.session.auth.username_in = <empty>
Aug 16 12:16:52 user nova-compute[73520]: node.session.auth.password_in = <empty>
Aug 16 12:16:52 user nova-compute[73520]: node.session.auth.chap_algs = MD5
Aug 16 12:16:52 user nova-compute[73520]: node.session.timeo.replacement_timeout = 120
Aug 16 12:16:52 user nova-compute[73520]: node.session.err_timeo.abort_timeout = 15
Aug 16 12:16:52 user nova-compute[73520]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 12:16:52 user nova-compute[73520]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 12:16:52 user nova-compute[73520]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 12:16:52 user nova-compute[73520]: node.session.iscsi.FastAbort = Yes
Aug 16 12:16:52 user nova-compute[73520]: node.session.iscsi.InitialR2T = No
Aug 16 12:16:52 user nova-compute[73520]: node.session.iscsi.ImmediateData = Yes
Aug 16 12:16:52 user nova-compute[73520]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 12:16:52 user nova-compute[73520]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 12:16:52 user nova-compute[73520]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 12:16:52 user nova-compute[73520]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 12:16:52 user nova-compute[73520]: node.session.iscsi.MaxConnections = 1
Aug 16 12:16:52 user nova-compute[73520]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 12:16:52 user nova-compute[73520]: node.session.iscsi.ERL = 0
Aug 16 12:16:52 user nova-compute[73520]: node.session.scan = manual
Aug 16 12:16:52 user nova-compute[73520]: node.session.reopen_max = 0
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].address = 172.16.0.220
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].port = 3260
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].startup = manual
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].tcp.window_size = 524288
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].tcp.type_of_service = 0
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].timeo.logout_timeout = 15
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].timeo.login_timeout = 15
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].timeo.auth_timeout = 45
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].iscsi.DataDigest = None
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].iscsi.IFMarker = No
Aug 16 12:16:52 user nova-compute[73520]: node.conn[0].iscsi.OFMarker = No
Aug 16 12:16:52 user nova-compute[73520]: # END RECORD
Aug 16 12:16:52 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ed790d-6d12-4c8c-8c4a-af23117d5661]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[791fce4e-799a-441c-ade0-6d2a13909f7c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDTKFyiv {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDTKFyiv" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[205741cd-2beb-412a-95d3-e9b430bb5230]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bDTKFyiv'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4247c11a-6363-4494-8d18-7c2c60ec1ed1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ec9a1a-a7f0-4b41-ac7a-b6e901a500ab]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:52 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:52 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:52 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:16:52 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:16:52 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:16:52 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] HCTL ('33', '0', '0', 0) found on session 19 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1608e6-7dee-46fc-81f8-082bf3675e6a]: (4, ('0 0 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Searching for a device in session 19 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDTKFyiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.185s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] <== connect_volume: return (186ms) {'type': 'block', 'scsi_wwn': '23434643536636264', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434643536636264', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1867177793',display_name='tempest-ServerStableDeviceRescueTest-server-1867177793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1867177793',id=2,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW1sULHDOwqYzwZNX8bdrBg2J4hzkPj384swsuGLaI5fdvQMlFCxH9VVU6Igf3uJTT5VzWdM2O6U06SbkepqbwghltsmDpN24/4L4JDgtpUfVbM6sx8uSo4KvWrF9zMfw==',key_name='tempest-keypair-1070714980',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:12:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ecfcad0609442ac978b2f28869a61a2',ramdisk_id='',reservation_id='r-35vu3dd3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-229465501',owner_user_name='tempest-ServerStableDeviceRescueTest-229465501-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92bb596f4b334418913e5aff74e0cd9b',uuid=2a72dbe6-dfc2-4527-8213-c2e9fe2f553a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "vif_mac": "fa:16:3e:58:a8:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Converting VIF {"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "vif_mac": "fa:16:3e:58:a8:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:a8:3f,bridge_name='br-int',has_traffic_filtering=True,id=e7070f8b-1a15-4dad-8fac-bd4518007ed3,network=Network(68120f7a-55c5-44f9-8ba2-7b43fb289064),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7070f8b-1a') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:16:52 user nova-compute[73520]:   <uuid>2a72dbe6-dfc2-4527-8213-c2e9fe2f553a</uuid>
Aug 16 12:16:52 user nova-compute[73520]:   <name>instance-00000002</name>
Aug 16 12:16:52 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:16:52 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:16:52 user nova-compute[73520]:   <metadata>
Aug 16 12:16:52 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:16:52 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:16:52 user nova-compute[73520]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1867177793</nova:name>
Aug 16 12:16:52 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:16:52</nova:creationTime>
Aug 16 12:16:52 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:16:52 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:16:52 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:16:52 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:16:52 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:16:52 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:16:52 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:16:52 user nova-compute[73520]:       <nova:owner>
Aug 16 12:16:52 user nova-compute[73520]:         <nova:user uuid="92bb596f4b334418913e5aff74e0cd9b">tempest-ServerStableDeviceRescueTest-229465501-project-member</nova:user>
Aug 16 12:16:52 user nova-compute[73520]:         <nova:project uuid="3ecfcad0609442ac978b2f28869a61a2">tempest-ServerStableDeviceRescueTest-229465501</nova:project>
Aug 16 12:16:52 user nova-compute[73520]:       </nova:owner>
Aug 16 12:16:52 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:16:52 user nova-compute[73520]:       <nova:ports>
Aug 16 12:16:52 user nova-compute[73520]:         <nova:port uuid="e7070f8b-1a15-4dad-8fac-bd4518007ed3">
Aug 16 12:16:52 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 12:16:52 user nova-compute[73520]:         </nova:port>
Aug 16 12:16:52 user nova-compute[73520]:       </nova:ports>
Aug 16 12:16:52 user nova-compute[73520]:     </nova:instance>
Aug 16 12:16:52 user nova-compute[73520]:   </metadata>
Aug 16 12:16:52 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:16:52 user nova-compute[73520]:     <system>
Aug 16 12:16:52 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:16:52 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:16:52 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:16:52 user nova-compute[73520]:       <entry name="serial">2a72dbe6-dfc2-4527-8213-c2e9fe2f553a</entry>
Aug 16 12:16:52 user nova-compute[73520]:       <entry name="uuid">2a72dbe6-dfc2-4527-8213-c2e9fe2f553a</entry>
Aug 16 12:16:52 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:16:52 user nova-compute[73520]:     </system>
Aug 16 12:16:52 user nova-compute[73520]:   </sysinfo>
Aug 16 12:16:52 user nova-compute[73520]:   <os>
Aug 16 12:16:52 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:16:52 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:16:52 user nova-compute[73520]:   </os>
Aug 16 12:16:52 user nova-compute[73520]:   <features>
Aug 16 12:16:52 user nova-compute[73520]:     <acpi/>
Aug 16 12:16:52 user nova-compute[73520]:     <apic/>
Aug 16 12:16:52 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:16:52 user nova-compute[73520]:   </features>
Aug 16 12:16:52 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:16:52 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:16:52 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:16:52 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:16:52 user nova-compute[73520]:   </clock>
Aug 16 12:16:52 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:16:52 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:16:52 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:16:52 user nova-compute[73520]:   </cpu>
Aug 16 12:16:52 user nova-compute[73520]:   <devices>
Aug 16 12:16:52 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:16:52 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:16:52 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk"/>
Aug 16 12:16:52 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:16:52 user nova-compute[73520]:     </disk>
Aug 16 12:16:52 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:16:52 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:16:52 user nova-compute[73520]:       <source dev="/dev/sdb"/>
Aug 16 12:16:52 user nova-compute[73520]:       <target dev="vdb" bus="virtio"/>
Aug 16 12:16:52 user nova-compute[73520]:       <serial>4154c7bd-d878-4e40-a992-01e251781ba0</serial>
Aug 16 12:16:52 user nova-compute[73520]:     </disk>
Aug 16 12:16:52 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:16:52 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:16:52 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.rescue"/>
Aug 16 12:16:52 user nova-compute[73520]:       <target dev="vdc" bus="virtio"/>
Aug 16 12:16:52 user nova-compute[73520]:       <boot order="1"/>
Aug 16 12:16:52 user nova-compute[73520]:     </disk>
Aug 16 12:16:52 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:16:52 user nova-compute[73520]:       <mac address="fa:16:3e:58:a8:3f"/>
Aug 16 12:16:52 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:16:52 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:16:52 user nova-compute[73520]:       <target dev="tape7070f8b-1a"/>
Aug 16 12:16:52 user nova-compute[73520]:     </interface>
Aug 16 12:16:52 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:16:52 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/console.log" append="off"/>
Aug 16 12:16:52 user nova-compute[73520]:     </serial>
Aug 16 12:16:52 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:16:52 user nova-compute[73520]:     <video>
Aug 16 12:16:52 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:16:52 user nova-compute[73520]:     </video>
Aug 16 12:16:52 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:16:52 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:16:52 user nova-compute[73520]:     </rng>
Aug 16 12:16:52 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:16:52 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:16:52 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:16:52 user nova-compute[73520]:     </memballoon>
Aug 16 12:16:52 user nova-compute[73520]:   </devices>
Aug 16 12:16:52 user nova-compute[73520]: </domain>
Aug 16 12:16:52 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:16:52 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Instance destroyed successfully.
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:16:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] No VIF found with MAC fa:16:3e:58:a8:3f, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:16:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG nova.network.neutron [req-1e723c5b-eff8-4706-bce0-812c5e9e053b req-b195b25f-d963-4c33-85f9-a68aefd37875 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Updated VIF entry in instance network info cache for port b9b63116-58c8-40ee-81cd-cf03d0f2ec88. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG nova.network.neutron [req-1e723c5b-eff8-4706-bce0-812c5e9e053b req-b195b25f-d963-4c33-85f9-a68aefd37875 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Updating instance_info_cache with network_info: [{"id": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "address": "fa:16:3e:07:c9:d0", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b63116-58", "ovs_interfaceid": "b9b63116-58c8-40ee-81cd-cf03d0f2ec88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-86725d78-6e55-442f-8a35-bd8f2efe5e73 req-06f6f2ba-e416-48ef-a715-57a87e94a859 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Received event network-vif-unplugged-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-86725d78-6e55-442f-8a35-bd8f2efe5e73 req-06f6f2ba-e416-48ef-a715-57a87e94a859 service nova] Acquiring lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-86725d78-6e55-442f-8a35-bd8f2efe5e73 req-06f6f2ba-e416-48ef-a715-57a87e94a859 service nova] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-86725d78-6e55-442f-8a35-bd8f2efe5e73 req-06f6f2ba-e416-48ef-a715-57a87e94a859 service nova] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-86725d78-6e55-442f-8a35-bd8f2efe5e73 req-06f6f2ba-e416-48ef-a715-57a87e94a859 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] No waiting events found dispatching network-vif-unplugged-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-86725d78-6e55-442f-8a35-bd8f2efe5e73 req-06f6f2ba-e416-48ef-a715-57a87e94a859 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Received event network-vif-unplugged-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-86725d78-6e55-442f-8a35-bd8f2efe5e73 req-06f6f2ba-e416-48ef-a715-57a87e94a859 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Received event network-vif-plugged-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-86725d78-6e55-442f-8a35-bd8f2efe5e73 req-06f6f2ba-e416-48ef-a715-57a87e94a859 service nova] Acquiring lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-86725d78-6e55-442f-8a35-bd8f2efe5e73 req-06f6f2ba-e416-48ef-a715-57a87e94a859 service nova] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-86725d78-6e55-442f-8a35-bd8f2efe5e73 req-06f6f2ba-e416-48ef-a715-57a87e94a859 service nova] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-86725d78-6e55-442f-8a35-bd8f2efe5e73 req-06f6f2ba-e416-48ef-a715-57a87e94a859 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] No waiting events found dispatching network-vif-plugged-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:54 user nova-compute[73520]: WARNING nova.compute.manager [req-86725d78-6e55-442f-8a35-bd8f2efe5e73 req-06f6f2ba-e416-48ef-a715-57a87e94a859 service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Received unexpected event network-vif-plugged-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 for instance with vm_state active and task_state deleting.
Aug 16 12:16:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1e723c5b-eff8-4706-bce0-812c5e9e053b req-b195b25f-d963-4c33-85f9-a68aefd37875 service nova] Releasing lock "refresh_cache-6ea9ce4f-479a-42c5-8610-1d1edd06e199" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:54 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Took 2.30 seconds to deallocate network for instance.
Aug 16 12:16:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:55 user nova-compute[73520]: DEBUG nova.compute.manager [req-60258ab2-cb24-435a-b528-5286d32bd819 req-7198ccb2-935d-4123-ba96-8a22b1153bd6 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-60258ab2-cb24-435a-b528-5286d32bd819 req-7198ccb2-935d-4123-ba96-8a22b1153bd6 service nova] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-60258ab2-cb24-435a-b528-5286d32bd819 req-7198ccb2-935d-4123-ba96-8a22b1153bd6 service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-60258ab2-cb24-435a-b528-5286d32bd819 req-7198ccb2-935d-4123-ba96-8a22b1153bd6 service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:55 user nova-compute[73520]: DEBUG nova.compute.manager [req-60258ab2-cb24-435a-b528-5286d32bd819 req-7198ccb2-935d-4123-ba96-8a22b1153bd6 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] No waiting events found dispatching network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:55 user nova-compute[73520]: WARNING nova.compute.manager [req-60258ab2-cb24-435a-b528-5286d32bd819 req-7198ccb2-935d-4123-ba96-8a22b1153bd6 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received unexpected event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 for instance with vm_state active and task_state rescuing.
Aug 16 12:16:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:55 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:16:55 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:16:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:55 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Deleted allocations for instance 6ea9ce4f-479a-42c5-8610-1d1edd06e199
Aug 16 12:16:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c7889cc7-0f65-411a-93be-2ca304893c24 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "6ea9ce4f-479a-42c5-8610-1d1edd06e199" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.195s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-4633c8ac-1249-4d71-ad36-6ee39283df9c req-82331f2a-426b-42df-8940-ba6106841c3d service nova] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Received event network-vif-deleted-b9b63116-58c8-40ee-81cd-cf03d0f2ec88 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-4633c8ac-1249-4d71-ad36-6ee39283df9c req-82331f2a-426b-42df-8940-ba6106841c3d service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-deleted-48df8bb9-8a61-49bd-b0b0-7a4b56b87660 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:56 user nova-compute[73520]: INFO nova.compute.manager [req-4633c8ac-1249-4d71-ad36-6ee39283df9c req-82331f2a-426b-42df-8940-ba6106841c3d service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Neutron deleted interface 48df8bb9-8a61-49bd-b0b0-7a4b56b87660; detaching it from the instance and deleting it from the info cache
Aug 16 12:16:56 user nova-compute[73520]: DEBUG nova.network.neutron [req-4633c8ac-1249-4d71-ad36-6ee39283df9c req-82331f2a-426b-42df-8940-ba6106841c3d service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [{"id": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "address": "fa:16:3e:49:3b:e0", "network": {"id": "742c040c-3528-4df9-9028-88841523fc19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1576139447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17b4d8a-28", "ovs_interfaceid": "a17b4d8a-28aa-450d-b11c-6254f52c9cbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2010228-e41b-4fe6-b814-cfb931b5107a", "address": "fa:16:3e:ed:da:23", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2010228-e4", "ovs_interfaceid": "d2010228-e41b-4fe6-b814-cfb931b5107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-4633c8ac-1249-4d71-ad36-6ee39283df9c req-82331f2a-426b-42df-8940-ba6106841c3d service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Detach interface failed, port_id=48df8bb9-8a61-49bd-b0b0-7a4b56b87660, reason: Instance d35ff623-3cb2-420f-98c6-9da333fa5cee could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:16:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Removed pending event for 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a due to event {{(pid=73520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 12:16:56 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188216.8445096, 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:16:56 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] VM Resumed (Lifecycle Event)
Aug 16 12:16:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-fa98f275-05c3-4f61-af3b-6e2df6394891 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:16:56 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 12:16:56 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188216.8461988, 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:16:56 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] VM Started (Lifecycle Event)
Aug 16 12:16:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:16:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:16:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-ed8f77b6-2692-4296-9fe1-dd52d209cffd req-7710f50f-5320-4e83-9aa8-4af6cf3cf68e service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed8f77b6-2692-4296-9fe1-dd52d209cffd req-7710f50f-5320-4e83-9aa8-4af6cf3cf68e service nova] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:16:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed8f77b6-2692-4296-9fe1-dd52d209cffd req-7710f50f-5320-4e83-9aa8-4af6cf3cf68e service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:16:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed8f77b6-2692-4296-9fe1-dd52d209cffd req-7710f50f-5320-4e83-9aa8-4af6cf3cf68e service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:16:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-ed8f77b6-2692-4296-9fe1-dd52d209cffd req-7710f50f-5320-4e83-9aa8-4af6cf3cf68e service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] No waiting events found dispatching network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:16:57 user nova-compute[73520]: WARNING nova.compute.manager [req-ed8f77b6-2692-4296-9fe1-dd52d209cffd req-7710f50f-5320-4e83-9aa8-4af6cf3cf68e service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received unexpected event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 for instance with vm_state rescued and task_state None.
Aug 16 12:16:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-ed8f77b6-2692-4296-9fe1-dd52d209cffd req-7710f50f-5320-4e83-9aa8-4af6cf3cf68e service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-deleted-43824ad0-ef35-4471-9ce5-ffedc9f3784a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:57 user nova-compute[73520]: INFO nova.compute.manager [req-ed8f77b6-2692-4296-9fe1-dd52d209cffd req-7710f50f-5320-4e83-9aa8-4af6cf3cf68e service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Neutron deleted interface 43824ad0-ef35-4471-9ce5-ffedc9f3784a; detaching it from the instance and deleting it from the info cache
Aug 16 12:16:57 user nova-compute[73520]: DEBUG nova.network.neutron [req-ed8f77b6-2692-4296-9fe1-dd52d209cffd req-7710f50f-5320-4e83-9aa8-4af6cf3cf68e service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [{"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "address": "fa:16:3e:d7:8c:a9", "network": {"id": "3cb0c534-8d1e-4a4c-bc75-9313c99b46ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-527162019", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60f87c0-2d", "ovs_interfaceid": "c60f87c0-2d15-4360-8fa0-bf406fff942d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-ed8f77b6-2692-4296-9fe1-dd52d209cffd req-7710f50f-5320-4e83-9aa8-4af6cf3cf68e service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Detach interface failed, port_id=43824ad0-ef35-4471-9ce5-ffedc9f3784a, reason: Instance ff7477c9-0c43-4aff-a7c3-e9311c965f40 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:16:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-4d536f61-37c8-4045-a67c-553b61904f41 req-460815ff-1bb5-4d57-ae61-bc17d22dbb21 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-deleted-a17b4d8a-28aa-450d-b11c-6254f52c9cbb {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:58 user nova-compute[73520]: INFO nova.compute.manager [req-4d536f61-37c8-4045-a67c-553b61904f41 req-460815ff-1bb5-4d57-ae61-bc17d22dbb21 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Neutron deleted interface a17b4d8a-28aa-450d-b11c-6254f52c9cbb; detaching it from the instance and deleting it from the info cache
Aug 16 12:16:58 user nova-compute[73520]: DEBUG nova.network.neutron [req-4d536f61-37c8-4045-a67c-553b61904f41 req-460815ff-1bb5-4d57-ae61-bc17d22dbb21 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [{"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2010228-e41b-4fe6-b814-cfb931b5107a", "address": "fa:16:3e:ed:da:23", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2010228-e4", "ovs_interfaceid": "d2010228-e41b-4fe6-b814-cfb931b5107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-4d536f61-37c8-4045-a67c-553b61904f41 req-460815ff-1bb5-4d57-ae61-bc17d22dbb21 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Detach interface failed, port_id=a17b4d8a-28aa-450d-b11c-6254f52c9cbb, reason: Instance d35ff623-3cb2-420f-98c6-9da333fa5cee could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:16:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-7e088136-0008-49a7-b9d2-ae1db73dca93 req-d3064839-499b-41e9-87c1-22b1c42779c2 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-deleted-c60f87c0-2d15-4360-8fa0-bf406fff942d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:59 user nova-compute[73520]: INFO nova.compute.manager [req-7e088136-0008-49a7-b9d2-ae1db73dca93 req-d3064839-499b-41e9-87c1-22b1c42779c2 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Neutron deleted interface c60f87c0-2d15-4360-8fa0-bf406fff942d; detaching it from the instance and deleting it from the info cache
Aug 16 12:16:59 user nova-compute[73520]: DEBUG nova.network.neutron [req-7e088136-0008-49a7-b9d2-ae1db73dca93 req-d3064839-499b-41e9-87c1-22b1c42779c2 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [{"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "address": "fa:16:3e:a8:d4:96", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f553a-1f", "ovs_interfaceid": "2c8f553a-1fb2-4a3b-80dd-0d549112f793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-7e088136-0008-49a7-b9d2-ae1db73dca93 req-d3064839-499b-41e9-87c1-22b1c42779c2 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Detach interface failed, port_id=c60f87c0-2d15-4360-8fa0-bf406fff942d, reason: Instance ff7477c9-0c43-4aff-a7c3-e9311c965f40 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:16:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-7e088136-0008-49a7-b9d2-ae1db73dca93 req-d3064839-499b-41e9-87c1-22b1c42779c2 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-deleted-2c8f553a-1fb2-4a3b-80dd-0d549112f793 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:59 user nova-compute[73520]: INFO nova.compute.manager [req-7e088136-0008-49a7-b9d2-ae1db73dca93 req-d3064839-499b-41e9-87c1-22b1c42779c2 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Neutron deleted interface 2c8f553a-1fb2-4a3b-80dd-0d549112f793; detaching it from the instance and deleting it from the info cache
Aug 16 12:16:59 user nova-compute[73520]: DEBUG nova.network.neutron [req-7e088136-0008-49a7-b9d2-ae1db73dca93 req-d3064839-499b-41e9-87c1-22b1c42779c2 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [{"id": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "address": "fa:16:3e:66:15:46", "network": {"id": "d4cc21ca-5d96-42cb-99ea-e8ac506baf8d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-317558235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0884bb-d1", "ovs_interfaceid": "ae0884bb-d1e5-41f4-82a1-cf1612acc3ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-7e088136-0008-49a7-b9d2-ae1db73dca93 req-d3064839-499b-41e9-87c1-22b1c42779c2 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Detach interface failed, port_id=2c8f553a-1fb2-4a3b-80dd-0d549112f793, reason: Instance ff7477c9-0c43-4aff-a7c3-e9311c965f40 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:16:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-7e088136-0008-49a7-b9d2-ae1db73dca93 req-d3064839-499b-41e9-87c1-22b1c42779c2 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-deleted-ae0884bb-d1e5-41f4-82a1-cf1612acc3ef {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:16:59 user nova-compute[73520]: INFO nova.compute.manager [req-7e088136-0008-49a7-b9d2-ae1db73dca93 req-d3064839-499b-41e9-87c1-22b1c42779c2 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Neutron deleted interface ae0884bb-d1e5-41f4-82a1-cf1612acc3ef; detaching it from the instance and deleting it from the info cache
Aug 16 12:16:59 user nova-compute[73520]: DEBUG nova.network.neutron [req-7e088136-0008-49a7-b9d2-ae1db73dca93 req-d3064839-499b-41e9-87c1-22b1c42779c2 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [{"id": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "address": "fa:16:3e:8e:ed:aa", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55dedb2f-d7", "ovs_interfaceid": "55dedb2f-d7f3-4f2e-bbff-90f53641c5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a983f522-a453-4636-a051-5780b31b3092", "address": "fa:16:3e:ee:53:42", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa983f522-a4", "ovs_interfaceid": "a983f522-a453-4636-a051-5780b31b3092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e289552d-05b7-418b-97c2-7d13c956b3fa", "address": "fa:16:3e:3b:4d:2d", "network": {"id": "e9d79c29-c4da-4ed6-b448-b2581a6e5f9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-171909882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "644147b7898849d188d90d8faf1224c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape289552d-05", "ovs_interfaceid": "e289552d-05b7-418b-97c2-7d13c956b3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:16:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-7e088136-0008-49a7-b9d2-ae1db73dca93 req-d3064839-499b-41e9-87c1-22b1c42779c2 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Detach interface failed, port_id=ae0884bb-d1e5-41f4-82a1-cf1612acc3ef, reason: Instance ff7477c9-0c43-4aff-a7c3-e9311c965f40 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:16:59 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:16:59 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Took 7.63 seconds to deallocate network for instance.
Aug 16 12:17:00 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188205.2721684, ff7477c9-0c43-4aff-a7c3-e9311c965f40 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:17:00 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] VM Stopped (Lifecycle Event)
Aug 16 12:17:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a151fc60-8898-4538-bfd2-395da781046a None None] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:17:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-b89bcd79-c168-41d7-adce-f7d457d1a443 req-55d1f8f3-3c2c-43d8-a038-a32980f70243 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-deleted-d2010228-e41b-4fe6-b814-cfb931b5107a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:17:00 user nova-compute[73520]: INFO nova.compute.manager [req-b89bcd79-c168-41d7-adce-f7d457d1a443 req-55d1f8f3-3c2c-43d8-a038-a32980f70243 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Neutron deleted interface d2010228-e41b-4fe6-b814-cfb931b5107a; detaching it from the instance and deleting it from the info cache
Aug 16 12:17:00 user nova-compute[73520]: DEBUG nova.network.neutron [req-b89bcd79-c168-41d7-adce-f7d457d1a443 req-55d1f8f3-3c2c-43d8-a038-a32980f70243 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [{"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "address": "fa:16:3e:32:c5:c8", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee409ffe-08", "ovs_interfaceid": "ee409ffe-08fa-490f-ab00-0c107a83ad39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:17:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-b89bcd79-c168-41d7-adce-f7d457d1a443 req-55d1f8f3-3c2c-43d8-a038-a32980f70243 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Detach interface failed, port_id=d2010228-e41b-4fe6-b814-cfb931b5107a, reason: Instance d35ff623-3cb2-420f-98c6-9da333fa5cee could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:17:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-b89bcd79-c168-41d7-adce-f7d457d1a443 req-55d1f8f3-3c2c-43d8-a038-a32980f70243 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-deleted-ee409ffe-08fa-490f-ab00-0c107a83ad39 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:17:00 user nova-compute[73520]: INFO nova.compute.manager [req-b89bcd79-c168-41d7-adce-f7d457d1a443 req-55d1f8f3-3c2c-43d8-a038-a32980f70243 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Neutron deleted interface ee409ffe-08fa-490f-ab00-0c107a83ad39; detaching it from the instance and deleting it from the info cache
Aug 16 12:17:00 user nova-compute[73520]: DEBUG nova.network.neutron [req-b89bcd79-c168-41d7-adce-f7d457d1a443 req-55d1f8f3-3c2c-43d8-a038-a32980f70243 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [{"id": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "address": "fa:16:3e:71:d9:37", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16cf4ff6-86", "ovs_interfaceid": "16cf4ff6-8636-43c0-95c6-8cd845011d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "address": "fa:16:3e:31:16:a5", "network": {"id": "b0956d4b-05a5-413d-b603-bb6557b2f4f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1930900502", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc775e42a-3c", "ovs_interfaceid": "c775e42a-3c5e-456f-ba77-911c8dc4aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "address": "fa:16:3e:9b:2e:9e", "network": {"id": "feeb920d-42cd-4e3a-b056-9e839d6622c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-921674146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e591da95a84cb0b3c2e42ff63b13ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9b32-53", "ovs_interfaceid": "d2be9b32-5339-4e58-abd1-02cf8c09b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:17:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-b89bcd79-c168-41d7-adce-f7d457d1a443 req-55d1f8f3-3c2c-43d8-a038-a32980f70243 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Detach interface failed, port_id=ee409ffe-08fa-490f-ab00-0c107a83ad39, reason: Instance d35ff623-3cb2-420f-98c6-9da333fa5cee could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:17:01 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188206.2970004, d35ff623-3cb2-420f-98c6-9da333fa5cee => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:17:01 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] VM Stopped (Lifecycle Event)
Aug 16 12:17:01 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:17:01 user nova-compute[73520]: DEBUG nova.compute.manager [req-3150a5af-7ec4-440f-95c8-b28d45571bcb req-90e7d375-427d-4e84-b3a8-02be90d58ae9 service nova] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Received event network-vif-deleted-e289552d-05b7-418b-97c2-7d13c956b3fa {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:17:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2d31183a-0311-4805-8884-3c222e1876fd None None] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:17:01 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Took 8.99 seconds to deallocate network for instance.
Aug 16 12:17:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:02 user nova-compute[73520]: DEBUG nova.compute.manager [req-6a15220a-0d28-44b5-a9b5-add0ba1f6423 req-fd8f643b-f3a5-4520-a68c-94e31f729ce5 service nova] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Received event network-vif-deleted-d2be9b32-5339-4e58-abd1-02cf8c09b9e2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:17:02 user nova-compute[73520]: INFO nova.compute.manager [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] [instance: ff7477c9-0c43-4aff-a7c3-e9311c965f40] Took 3.48 seconds to detach 3 volumes for instance.
Aug 16 12:17:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:03 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:17:03 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:17:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.520s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:03 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Deleted allocations for instance ff7477c9-0c43-4aff-a7c3-e9311c965f40
Aug 16 12:17:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c05c7db0-e7f1-4fa1-9b66-ef84450320b5 tempest-TaggedBootDevicesTest_v242-49110099 tempest-TaggedBootDevicesTest_v242-49110099-project-member] Lock "ff7477c9-0c43-4aff-a7c3-e9311c965f40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 21.284s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:04 user nova-compute[73520]: INFO nova.compute.manager [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] [instance: d35ff623-3cb2-420f-98c6-9da333fa5cee] Took 3.29 seconds to detach 3 volumes for instance.
Aug 16 12:17:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:05 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:17:05 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:17:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:05 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Deleted allocations for instance d35ff623-3cb2-420f-98c6-9da333fa5cee
Aug 16 12:17:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-df184814-533b-47f0-8990-1fd203b27dbd tempest-TaggedBootDevicesTest-1030514499 tempest-TaggedBootDevicesTest-1030514499-project-member] Lock "d35ff623-3cb2-420f-98c6-9da333fa5cee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 21.416s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:07 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188212.2640557, 6ea9ce4f-479a-42c5-8610-1d1edd06e199 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:17:07 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] VM Stopped (Lifecycle Event)
Aug 16 12:17:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-e9dbe941-02c6-410f-a68d-c439419e118e None None] [instance: 6ea9ce4f-479a-42c5-8610-1d1edd06e199] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:17:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:09 user nova-compute[73520]: INFO nova.compute.manager [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Terminating instance
Aug 16 12:17:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:17:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-1bbe6add-42a3-4748-82f5-fbdec800f29d req-143b7f49-4dd6-4bc6-acc7-7c966fb3c5e3 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Received event network-vif-unplugged-4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1bbe6add-42a3-4748-82f5-fbdec800f29d req-143b7f49-4dd6-4bc6-acc7-7c966fb3c5e3 service nova] Acquiring lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1bbe6add-42a3-4748-82f5-fbdec800f29d req-143b7f49-4dd6-4bc6-acc7-7c966fb3c5e3 service nova] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1bbe6add-42a3-4748-82f5-fbdec800f29d req-143b7f49-4dd6-4bc6-acc7-7c966fb3c5e3 service nova] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-1bbe6add-42a3-4748-82f5-fbdec800f29d req-143b7f49-4dd6-4bc6-acc7-7c966fb3c5e3 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] No waiting events found dispatching network-vif-unplugged-4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-1bbe6add-42a3-4748-82f5-fbdec800f29d req-143b7f49-4dd6-4bc6-acc7-7c966fb3c5e3 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Received event network-vif-unplugged-4512d351-5628-4309-990f-dff795735e3c for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:17:10 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Instance destroyed successfully.
Aug 16 12:17:10 user nova-compute[73520]: DEBUG nova.objects.instance [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lazy-loading 'resources' on Instance uuid c1492de2-3545-4ef7-bf3d-07e779d73f8d {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1467733343',display_name='tempest-TestVolumeSwap-server-1467733343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1467733343',id=8,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqMjvh9FEAY/6eTNhd+QmbI8M6gvMJWNxKj1zvkoJMwV2mwoLaLIeEXbk9s1tCLroA6f5FwBHrsRnEV5D0Ykt5S0swbDyD1aBMJke1WyAkAl5XpC4L5rGbrfxLGluO4Tw==',key_name='tempest-keypair-1812386384',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c922281e6ebc4d9a94b2f4bed5de8c60',ramdisk_id='',reservation_id='r-vus97gae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-657380562',owner_user_name='tempest-TestVolumeSwap-657380562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a805ae6baee474691c122bafeb4281d',uuid=c1492de2-3545-4ef7-bf3d-07e779d73f8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4512d351-5628-4309-990f-dff795735e3c", "address": "fa:16:3e:4b:49:90", "network": {"id": "7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-954407765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c922281e6ebc4d9a94b2f4bed5de8c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4512d351-56", "ovs_interfaceid": "4512d351-5628-4309-990f-dff795735e3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Converting VIF {"id": "4512d351-5628-4309-990f-dff795735e3c", "address": "fa:16:3e:4b:49:90", "network": {"id": "7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-954407765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c922281e6ebc4d9a94b2f4bed5de8c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4512d351-56", "ovs_interfaceid": "4512d351-5628-4309-990f-dff795735e3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:49:90,bridge_name='br-int',has_traffic_filtering=True,id=4512d351-5628-4309-990f-dff795735e3c,network=Network(7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4512d351-56') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG os_vif [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:49:90,bridge_name='br-int',has_traffic_filtering=True,id=4512d351-5628-4309-990f-dff795735e3c,network=Network(7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4512d351-56') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4512d351-56, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:17:10 user nova-compute[73520]: INFO os_vif [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:49:90,bridge_name='br-int',has_traffic_filtering=True,id=4512d351-5628-4309-990f-dff795735e3c,network=Network(7bf935e2-6a39-4897-b2c9-61bb7ed3bd0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4512d351-56')
Aug 16 12:17:10 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Deleting instance files /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d_del
Aug 16 12:17:10 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Deletion of /opt/stack/data/nova/instances/c1492de2-3545-4ef7-bf3d-07e779d73f8d_del complete
Aug 16 12:17:10 user nova-compute[73520]: INFO nova.compute.manager [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 16 12:17:10 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:17:10 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:17:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-a29849f8-41d4-42d8-8f38-f904915a3430 req-89d33450-01d1-4062-8f57-c50d9e0f89ea service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Received event network-vif-plugged-4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:17:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a29849f8-41d4-42d8-8f38-f904915a3430 req-89d33450-01d1-4062-8f57-c50d9e0f89ea service nova] Acquiring lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a29849f8-41d4-42d8-8f38-f904915a3430 req-89d33450-01d1-4062-8f57-c50d9e0f89ea service nova] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a29849f8-41d4-42d8-8f38-f904915a3430 req-89d33450-01d1-4062-8f57-c50d9e0f89ea service nova] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-a29849f8-41d4-42d8-8f38-f904915a3430 req-89d33450-01d1-4062-8f57-c50d9e0f89ea service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] No waiting events found dispatching network-vif-plugged-4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:17:12 user nova-compute[73520]: WARNING nova.compute.manager [req-a29849f8-41d4-42d8-8f38-f904915a3430 req-89d33450-01d1-4062-8f57-c50d9e0f89ea service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Received unexpected event network-vif-plugged-4512d351-5628-4309-990f-dff795735e3c for instance with vm_state active and task_state deleting.
Aug 16 12:17:12 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:17:12 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Took 1.73 seconds to deallocate network for instance.
Aug 16 12:17:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-eef10723-fa1c-441a-bea9-cc9c0d198c1e req-b576cd84-1ce7-4648-88eb-869aabac4cb4 service nova] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Received event network-vif-deleted-4512d351-5628-4309-990f-dff795735e3c {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:17:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:13 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:17:13 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:17:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:13 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Deleted allocations for instance c1492de2-3545-4ef7-bf3d-07e779d73f8d
Aug 16 12:17:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-08a1cbb1-53b8-4e86-b813-b1ced3e6b303 tempest-TestVolumeSwap-657380562 tempest-TestVolumeSwap-657380562-project-member] Lock "c1492de2-3545-4ef7-bf3d-07e779d73f8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.603s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:15 user nova-compute[73520]: DEBUG nova.compute.manager [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:17:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:15 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:17:15 user nova-compute[73520]: INFO nova.compute.claims [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Claim successful on node user
Aug 16 12:17:16 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:17:16 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:17:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG nova.policy [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7e48ee408e24af083b40b19437cfbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed29e455a840474b8a1407af538883ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:17:16 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Creating image(s)
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "/opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "/opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "/opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.192s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk 1073741824" returned: 0 in 0.054s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.213s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:17 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:17:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Successfully created port: f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:17:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:17 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Cannot resize image /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:17:17 user nova-compute[73520]: DEBUG nova.objects.instance [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'migration_context' on Instance uuid b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:17:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:17:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Ensure instance console log exists: /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:17:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.network.neutron [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Successfully updated port: f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquired lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.network.neutron [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-dd16196c-c2c6-40f9-9fc6-7a91e4e9f35b req-4e1452e8-e187-4e17-9784-cfc51c9a657a service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-changed-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-dd16196c-c2c6-40f9-9fc6-7a91e4e9f35b req-4e1452e8-e187-4e17-9784-cfc51c9a657a service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Refreshing instance network info cache due to event network-changed-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-dd16196c-c2c6-40f9-9fc6-7a91e4e9f35b req-4e1452e8-e187-4e17-9784-cfc51c9a657a service nova] Acquiring lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.network.neutron [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.network.neutron [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updating instance_info_cache with network_info: [{"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Releasing lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Instance network_info: |[{"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-dd16196c-c2c6-40f9-9fc6-7a91e4e9f35b req-4e1452e8-e187-4e17-9784-cfc51c9a657a service nova] Acquired lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.network.neutron [req-dd16196c-c2c6-40f9-9fc6-7a91e4e9f35b req-4e1452e8-e187-4e17-9784-cfc51c9a657a service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Refreshing network info cache for port f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Start _get_guest_xml network_info=[{"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:17:18 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:17:18 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-466509847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-466509847',id=16,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/TnCMohAy4YwXrP4QswrIkP1s67kKydcbM5umHWevLWUF7aB+KeIUkVDD5UpM/sLWKALtErDoubQvYXCvUMMCn8aBxFpkp9OZ9pdoPDYMWBV95Mwsn9Y+0MGtOI3A22Q==',key_name='tempest-keypair-536458928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed29e455a840474b8a1407af538883ab',ramdisk_id='',reservation_id='r-ivvsky98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-974908846',owner_user_name='tempest-AttachVolumeShelveTestJSON-974908846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7e48ee408e24af083b40b19437cfbac',uuid=b58731e0-399d-4f8d-84b8-af12a46cf87f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converting VIF {"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.objects.instance [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'pci_devices' on Instance uuid b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:17:18 user nova-compute[73520]:   <uuid>b58731e0-399d-4f8d-84b8-af12a46cf87f</uuid>
Aug 16 12:17:18 user nova-compute[73520]:   <name>instance-00000010</name>
Aug 16 12:17:18 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:17:18 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:17:18 user nova-compute[73520]:   <metadata>
Aug 16 12:17:18 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:17:18 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:17:18 user nova-compute[73520]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-466509847</nova:name>
Aug 16 12:17:18 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:17:18</nova:creationTime>
Aug 16 12:17:18 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:17:18 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:17:18 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:17:18 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:17:18 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:17:18 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:17:18 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:17:18 user nova-compute[73520]:       <nova:owner>
Aug 16 12:17:18 user nova-compute[73520]:         <nova:user uuid="b7e48ee408e24af083b40b19437cfbac">tempest-AttachVolumeShelveTestJSON-974908846-project-member</nova:user>
Aug 16 12:17:18 user nova-compute[73520]:         <nova:project uuid="ed29e455a840474b8a1407af538883ab">tempest-AttachVolumeShelveTestJSON-974908846</nova:project>
Aug 16 12:17:18 user nova-compute[73520]:       </nova:owner>
Aug 16 12:17:18 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:17:18 user nova-compute[73520]:       <nova:ports>
Aug 16 12:17:18 user nova-compute[73520]:         <nova:port uuid="f9fc71dc-3ee9-497a-a60e-e39046c2d9f3">
Aug 16 12:17:18 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 12:17:18 user nova-compute[73520]:         </nova:port>
Aug 16 12:17:18 user nova-compute[73520]:       </nova:ports>
Aug 16 12:17:18 user nova-compute[73520]:     </nova:instance>
Aug 16 12:17:18 user nova-compute[73520]:   </metadata>
Aug 16 12:17:18 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:17:18 user nova-compute[73520]:     <system>
Aug 16 12:17:18 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:17:18 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:17:18 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:17:18 user nova-compute[73520]:       <entry name="serial">b58731e0-399d-4f8d-84b8-af12a46cf87f</entry>
Aug 16 12:17:18 user nova-compute[73520]:       <entry name="uuid">b58731e0-399d-4f8d-84b8-af12a46cf87f</entry>
Aug 16 12:17:18 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:17:18 user nova-compute[73520]:     </system>
Aug 16 12:17:18 user nova-compute[73520]:   </sysinfo>
Aug 16 12:17:18 user nova-compute[73520]:   <os>
Aug 16 12:17:18 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:17:18 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:17:18 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:17:18 user nova-compute[73520]:   </os>
Aug 16 12:17:18 user nova-compute[73520]:   <features>
Aug 16 12:17:18 user nova-compute[73520]:     <acpi/>
Aug 16 12:17:18 user nova-compute[73520]:     <apic/>
Aug 16 12:17:18 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:17:18 user nova-compute[73520]:   </features>
Aug 16 12:17:18 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:17:18 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:17:18 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:17:18 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:17:18 user nova-compute[73520]:   </clock>
Aug 16 12:17:18 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:17:18 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:17:18 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:17:18 user nova-compute[73520]:   </cpu>
Aug 16 12:17:18 user nova-compute[73520]:   <devices>
Aug 16 12:17:18 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:17:18 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:17:18 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk"/>
Aug 16 12:17:18 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:17:18 user nova-compute[73520]:     </disk>
Aug 16 12:17:18 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:17:18 user nova-compute[73520]:       <mac address="fa:16:3e:e6:e2:11"/>
Aug 16 12:17:18 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:17:18 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:17:18 user nova-compute[73520]:       <target dev="tapf9fc71dc-3e"/>
Aug 16 12:17:18 user nova-compute[73520]:     </interface>
Aug 16 12:17:18 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:17:18 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/console.log" append="off"/>
Aug 16 12:17:18 user nova-compute[73520]:     </serial>
Aug 16 12:17:18 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:17:18 user nova-compute[73520]:     <video>
Aug 16 12:17:18 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:17:18 user nova-compute[73520]:     </video>
Aug 16 12:17:18 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:17:18 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:17:18 user nova-compute[73520]:     </rng>
Aug 16 12:17:18 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:17:18 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:17:18 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:17:18 user nova-compute[73520]:     </memballoon>
Aug 16 12:17:18 user nova-compute[73520]:   </devices>
Aug 16 12:17:18 user nova-compute[73520]: </domain>
Aug 16 12:17:18 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-466509847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-466509847',id=16,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/TnCMohAy4YwXrP4QswrIkP1s67kKydcbM5umHWevLWUF7aB+KeIUkVDD5UpM/sLWKALtErDoubQvYXCvUMMCn8aBxFpkp9OZ9pdoPDYMWBV95Mwsn9Y+0MGtOI3A22Q==',key_name='tempest-keypair-536458928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed29e455a840474b8a1407af538883ab',ramdisk_id='',reservation_id='r-ivvsky98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-974908846',owner_user_name='tempest-AttachVolumeShelveTestJSON-974908846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7e48ee408e24af083b40b19437cfbac',uuid=b58731e0-399d-4f8d-84b8-af12a46cf87f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converting VIF {"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG os_vif [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9fc71dc-3e, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9fc71dc-3e, col_values=(('external_ids', {'iface-id': 'f9fc71dc-3ee9-497a-a60e-e39046c2d9f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:e2:11', 'vm-uuid': 'b58731e0-399d-4f8d-84b8-af12a46cf87f'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:18 user nova-compute[73520]: INFO os_vif [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e')
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:17:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] No VIF found with MAC fa:16:3e:e6:e2:11, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:17:19 user nova-compute[73520]: DEBUG nova.network.neutron [req-dd16196c-c2c6-40f9-9fc6-7a91e4e9f35b req-4e1452e8-e187-4e17-9784-cfc51c9a657a service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updated VIF entry in instance network info cache for port f9fc71dc-3ee9-497a-a60e-e39046c2d9f3. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:17:19 user nova-compute[73520]: DEBUG nova.network.neutron [req-dd16196c-c2c6-40f9-9fc6-7a91e4e9f35b req-4e1452e8-e187-4e17-9784-cfc51c9a657a service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updating instance_info_cache with network_info: [{"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:17:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-dd16196c-c2c6-40f9-9fc6-7a91e4e9f35b req-4e1452e8-e187-4e17-9784-cfc51c9a657a service nova] Releasing lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:17:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-7f3b1010-c95f-4550-af92-7a91d6f35c1e req-8e5129a1-d33e-4252-9b65-7c6ed560023b service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:17:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7f3b1010-c95f-4550-af92-7a91d6f35c1e req-8e5129a1-d33e-4252-9b65-7c6ed560023b service nova] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7f3b1010-c95f-4550-af92-7a91d6f35c1e req-8e5129a1-d33e-4252-9b65-7c6ed560023b service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7f3b1010-c95f-4550-af92-7a91d6f35c1e req-8e5129a1-d33e-4252-9b65-7c6ed560023b service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-7f3b1010-c95f-4550-af92-7a91d6f35c1e req-8e5129a1-d33e-4252-9b65-7c6ed560023b service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] No waiting events found dispatching network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:17:20 user nova-compute[73520]: WARNING nova.compute.manager [req-7f3b1010-c95f-4550-af92-7a91d6f35c1e req-8e5129a1-d33e-4252-9b65-7c6ed560023b service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received unexpected event network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 for instance with vm_state building and task_state spawning.
Aug 16 12:17:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-e7efd868-bea2-47f8-bf65-ffbd77369dcb req-fb98a6c6-a882-486f-bc76-2a6a11ee55c0 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e7efd868-bea2-47f8-bf65-ffbd77369dcb req-fb98a6c6-a882-486f-bc76-2a6a11ee55c0 service nova] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e7efd868-bea2-47f8-bf65-ffbd77369dcb req-fb98a6c6-a882-486f-bc76-2a6a11ee55c0 service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e7efd868-bea2-47f8-bf65-ffbd77369dcb req-fb98a6c6-a882-486f-bc76-2a6a11ee55c0 service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-e7efd868-bea2-47f8-bf65-ffbd77369dcb req-fb98a6c6-a882-486f-bc76-2a6a11ee55c0 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] No waiting events found dispatching network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:17:22 user nova-compute[73520]: WARNING nova.compute.manager [req-e7efd868-bea2-47f8-bf65-ffbd77369dcb req-fb98a6c6-a882-486f-bc76-2a6a11ee55c0 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received unexpected event network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 for instance with vm_state building and task_state spawning.
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188242.7254505, b58731e0-399d-4f8d-84b8-af12a46cf87f => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:17:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] VM Resumed (Lifecycle Event)
Aug 16 12:17:22 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Instance spawned successfully.
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:17:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188242.7257416, b58731e0-399d-4f8d-84b8-af12a46cf87f => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:17:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] VM Started (Lifecycle Event)
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:17:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:17:22 user nova-compute[73520]: INFO nova.compute.manager [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Took 6.29 seconds to spawn the instance on the hypervisor.
Aug 16 12:17:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:17:22 user nova-compute[73520]: INFO nova.compute.manager [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Took 7.08 seconds to build instance.
Aug 16 12:17:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-347b9e66-0d7e-4793-9f79-ba578b7c524a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.175s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:25 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188230.6519125, c1492de2-3545-4ef7-bf3d-07e779d73f8d => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:17:25 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] VM Stopped (Lifecycle Event)
Aug 16 12:17:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cc5e666a-0287-41d8-8816-5f0de0a2211a None None] [instance: c1492de2-3545-4ef7-bf3d-07e779d73f8d] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:17:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:17:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:27 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:17:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:28 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:17:29 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:17:29 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:17:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:17:30 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:17:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:30 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:17:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:17:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:17:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:17:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.rescue --force-share --output=json" returned: 0 in 0.253s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:35 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:17:35 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7487MB free_disk=25.602893829345703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 636510f6-acfa-4705-bfb1-03df3f9297be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1e35c753-7af1-4047-ad06-8b5755207b8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2462cd5c-8c3b-49e6-82a9-6539c57edb1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance b58731e0-399d-4f8d-84b8-af12a46cf87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:17:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:36 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:17:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:17:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-1e35c753-7af1-4047-ad06-8b5755207b8e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:17:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-1e35c753-7af1-4047-ad06-8b5755207b8e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:17:37 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:17:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Updating instance_info_cache with network_info: [{"id": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "address": "fa:16:3e:1f:c7:00", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9436b2f8-8b", "ovs_interfaceid": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:17:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-1e35c753-7af1-4047-ad06-8b5755207b8e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:17:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:17:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:17:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:17:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "636510f6-acfa-4705-bfb1-03df3f9297be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:17:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "636510f6-acfa-4705-bfb1-03df3f9297be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:17:43 user nova-compute[73520]: INFO nova.compute.manager [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Detaching volume eed03927-73a8-4479-8c02-236d471ead4f
Aug 16 12:17:43 user nova-compute[73520]: INFO nova.virt.block_device [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Attempting to driver detach volume eed03927-73a8-4479-8c02-236d471ead4f from mountpoint /dev/vdb
Aug 16 12:17:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Attempting to detach device vdb from instance 636510f6-acfa-4705-bfb1-03df3f9297be from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:17:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:17:43 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:17:43 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:17:43 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:17:43 user nova-compute[73520]:   <serial>eed03927-73a8-4479-8c02-236d471ead4f</serial>
Aug 16 12:17:43 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:17:43 user nova-compute[73520]: </disk>
Aug 16 12:17:43 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:17:43 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully detached device vdb from instance 636510f6-acfa-4705-bfb1-03df3f9297be from the persistent domain config.
Aug 16 12:17:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 636510f6-acfa-4705-bfb1-03df3f9297be from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:17:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:17:43 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:17:43 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:17:43 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:17:43 user nova-compute[73520]:   <serial>eed03927-73a8-4479-8c02-236d471ead4f</serial>
Aug 16 12:17:43 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:17:43 user nova-compute[73520]: </disk>
Aug 16 12:17:43 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:17:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188264.1729007, 636510f6-acfa-4705-bfb1-03df3f9297be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 636510f6-acfa-4705-bfb1-03df3f9297be {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:17:44 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully detached device vdb from instance 636510f6-acfa-4705-bfb1-03df3f9297be from the live domain config.
Aug 16 12:17:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htmqQvWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:17:44 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41b02af-69e9-4aa7-b09b-5e82f10f0de0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b79dc8-835f-4b62-9d5b-e685934c4f5b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:17:44 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:17:44 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:17:44 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:17:44 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:17:44 user nova-compute[73520]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f (non-flash)
Aug 16 12:17:44 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c117d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f'): ({'sdc'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Removing single pathed devices sdc {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70d9f48-c535-43ca-9b86-5ca2a4e42e96]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc4855c-de70-477b-8006-e7cadd904ed2]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Flushing IO for device /dev/sdc {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aa086f-b1c6-4bce-bb4b-c23f12f1b446]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[870a1dad-d4ef-4d8f-a0ef-7a94c9da5056]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e6f5f6-63d7-4869-9e3f-ba8666690f34]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7335c8-8eba-4983-8e5a-0bb415b2ad6e]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f, portal: 172.16.0.220,3260]
Aug 16 12:17:44 user nova-compute[73520]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f, portal: 172.16.0.220,3260] successful.
Aug 16 12:17:44 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed03927-73a8-4479-8c02-236d471ead4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a7a2db-8d0d-4468-a0be-c3f2c4819467]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] <== disconnect_volume: return (341ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:17:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:17:45 user nova-compute[73520]: DEBUG nova.objects.instance [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'flavor' on Instance uuid 636510f6-acfa-4705-bfb1-03df3f9297be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:17:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-bbf6373a-456e-44ce-b2af-66c9338cb81a tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "636510f6-acfa-4705-bfb1-03df3f9297be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.962s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:17:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:17:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:17:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:17:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:17:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:17:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:18:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:18:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:18:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:18:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:04 user nova-compute[73520]: INFO nova.compute.manager [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Terminating instance
Aug 16 12:18:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-fcb04fb7-99b5-429e-a9f0-bb956325d1b8 req-e06d463f-8d45-4879-9a51-5c91a9693d9e service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received event network-vif-unplugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-fcb04fb7-99b5-429e-a9f0-bb956325d1b8 req-e06d463f-8d45-4879-9a51-5c91a9693d9e service nova] Acquiring lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-fcb04fb7-99b5-429e-a9f0-bb956325d1b8 req-e06d463f-8d45-4879-9a51-5c91a9693d9e service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-fcb04fb7-99b5-429e-a9f0-bb956325d1b8 req-e06d463f-8d45-4879-9a51-5c91a9693d9e service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-fcb04fb7-99b5-429e-a9f0-bb956325d1b8 req-e06d463f-8d45-4879-9a51-5c91a9693d9e service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] No waiting events found dispatching network-vif-unplugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-fcb04fb7-99b5-429e-a9f0-bb956325d1b8 req-e06d463f-8d45-4879-9a51-5c91a9693d9e service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received event network-vif-unplugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:18:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Instance destroyed successfully.
Aug 16 12:18:05 user nova-compute[73520]: DEBUG nova.objects.instance [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lazy-loading 'resources' on Instance uuid 2462cd5c-8c3b-49e6-82a9-6539c57edb1e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:13:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1943253361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1649896200',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5lfnNQjk309WHNPoJplqkTWZJCEIgsyDnf1ntfB3MA1o2pn1nFQq7KWgW/Px4t5P3JE58yASksLFE80axLqKjOyguTxIgo/Xo+NW6ip7AMowz4RnKZLCPN8GpS0T7CgA==',key_name='tempest-keypair-280741756',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:16:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d27d28a99784c87ae3a67834abbcc38',ramdisk_id='',reservation_id='r-2ozrmaur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-847817773',owner_user_name='tempest-ServerActionsV293TestJSON-847817773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:16:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cabd18e57f6f4859a0e86ab2e4360721',uuid=2462cd5c-8c3b-49e6-82a9-6539c57edb1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Converting VIF {"id": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "address": "fa:16:3e:ec:38:f9", "network": {"id": "714ca5c2-6d43-4c55-8281-816fd4a16cc3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-802829471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27d28a99784c87ae3a67834abbcc38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb56176-13", "ovs_interfaceid": "dbb56176-1321-4be7-b72f-4c2bb0d9f9af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_vif [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbb56176-13, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:18:05 user nova-compute[73520]: INFO os_vif [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=dbb56176-1321-4be7-b72f-4c2bb0d9f9af,network=Network(714ca5c2-6d43-4c55-8281-816fd4a16cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb56176-13')
Aug 16 12:18:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfvZMXCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:18:05 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dca8d4-0352-4bf0-b003-1946f7276b95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e965e1-13c9-4da9-bcdb-9fb10f6cfb8e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:18:05 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:05 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 (non-flash)
Aug 16 12:18:05 user nova-compute[73520]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:05 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c11cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525'): ({'sdj'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Removing single pathed devices sdj {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b0aa83-0c8b-46c0-acd7-f1334b9f99ae]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89623fd-b310-49f5-bf68-3b1c499bfd15]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Flushing IO for device /dev/sdj {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5243caf7-b67c-4649-a6e0-00ab4f064d08]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.061s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[829dab7c-b6e1-4fb8-8058-02b23345d935]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] SCSI volumes sdj have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26331306536633834', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f8fc2939', '/dev/disk/by-id/scsi-1SCST_BIOf8fc2939-c10e6c84a05d3aee') {{(pid=84372) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c921f347-c5fe-4802-a662-79a1fb485904]: (4, None) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[194a861f-c834-429f-9e51-e32b17f024bc]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8becfa38-351b-4964-9401-75f86be772b3]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260]
Aug 16 12:18:05 user nova-compute[73520]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525, portal: 172.16.0.220,3260] successful.
Aug 16 12:18:05 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a466b2-9d08-4a37-9932-1b71914de525 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d07c41-9ef9-4ef1-8dd7-5ad0cdeae9c5]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] <== disconnect_volume: return (349ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:18:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Deleting instance files /opt/stack/data/nova/instances/2462cd5c-8c3b-49e6-82a9-6539c57edb1e_del
Aug 16 12:18:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Deletion of /opt/stack/data/nova/instances/2462cd5c-8c3b-49e6-82a9-6539c57edb1e_del complete
Aug 16 12:18:05 user nova-compute[73520]: INFO nova.compute.manager [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 16 12:18:05 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:18:05 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:18:06 user nova-compute[73520]: DEBUG nova.compute.manager [req-be270f5f-5127-4ddc-a85f-7a172647969c req-24da0e51-8625-41ea-ac94-ff1ae4ffb457 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received event network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-be270f5f-5127-4ddc-a85f-7a172647969c req-24da0e51-8625-41ea-ac94-ff1ae4ffb457 service nova] Acquiring lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-be270f5f-5127-4ddc-a85f-7a172647969c req-24da0e51-8625-41ea-ac94-ff1ae4ffb457 service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-be270f5f-5127-4ddc-a85f-7a172647969c req-24da0e51-8625-41ea-ac94-ff1ae4ffb457 service nova] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:06 user nova-compute[73520]: DEBUG nova.compute.manager [req-be270f5f-5127-4ddc-a85f-7a172647969c req-24da0e51-8625-41ea-ac94-ff1ae4ffb457 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] No waiting events found dispatching network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:06 user nova-compute[73520]: WARNING nova.compute.manager [req-be270f5f-5127-4ddc-a85f-7a172647969c req-24da0e51-8625-41ea-ac94-ff1ae4ffb457 service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received unexpected event network-vif-plugged-dbb56176-1321-4be7-b72f-4c2bb0d9f9af for instance with vm_state active and task_state deleting.
Aug 16 12:18:07 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:18:07 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Took 1.64 seconds to deallocate network for instance.
Aug 16 12:18:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-b4e2413f-30c5-4842-8c51-1200278059f6 req-f7353731-6815-4578-a0f5-9a024376ec3f service nova] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Received event network-vif-deleted-dbb56176-1321-4be7-b72f-4c2bb0d9f9af {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:08 user nova-compute[73520]: INFO nova.compute.manager [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Took 0.84 seconds to detach 1 volumes for instance.
Aug 16 12:18:08 user nova-compute[73520]: DEBUG nova.compute.manager [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Deleting volume: f1a466b2-9d08-4a37-9932-1b71914de525 {{(pid=73520) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 12:18:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:08 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:18:08 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:18:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:08 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Deleted allocations for instance 2462cd5c-8c3b-49e6-82a9-6539c57edb1e
Aug 16 12:18:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0ab04ee7-1a30-42a3-b907-e8fd3498d29e tempest-ServerActionsV293TestJSON-847817773 tempest-ServerActionsV293TestJSON-847817773-project-member] Lock "2462cd5c-8c3b-49e6-82a9-6539c57edb1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.408s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-eaf1c757-81bf-4356-aef6-a3868c6b9333 req-c92f2de7-7771-42c9-af62-b400e3830f22 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received event network-changed-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-eaf1c757-81bf-4356-aef6-a3868c6b9333 req-c92f2de7-7771-42c9-af62-b400e3830f22 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Refreshing instance network info cache due to event network-changed-27a8f0eb-6244-4a6c-81e7-977795d5ea41. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:18:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-eaf1c757-81bf-4356-aef6-a3868c6b9333 req-c92f2de7-7771-42c9-af62-b400e3830f22 service nova] Acquiring lock "refresh_cache-5bc17e5d-3ae1-474d-bd49-71c60f3e46be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:18:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-eaf1c757-81bf-4356-aef6-a3868c6b9333 req-c92f2de7-7771-42c9-af62-b400e3830f22 service nova] Acquired lock "refresh_cache-5bc17e5d-3ae1-474d-bd49-71c60f3e46be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:18:18 user nova-compute[73520]: DEBUG nova.network.neutron [req-eaf1c757-81bf-4356-aef6-a3868c6b9333 req-c92f2de7-7771-42c9-af62-b400e3830f22 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Refreshing network info cache for port 27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:18:19 user nova-compute[73520]: DEBUG nova.network.neutron [req-eaf1c757-81bf-4356-aef6-a3868c6b9333 req-c92f2de7-7771-42c9-af62-b400e3830f22 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Updated VIF entry in instance network info cache for port 27a8f0eb-6244-4a6c-81e7-977795d5ea41. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:18:19 user nova-compute[73520]: DEBUG nova.network.neutron [req-eaf1c757-81bf-4356-aef6-a3868c6b9333 req-c92f2de7-7771-42c9-af62-b400e3830f22 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Updating instance_info_cache with network_info: [{"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:18:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-eaf1c757-81bf-4356-aef6-a3868c6b9333 req-c92f2de7-7771-42c9-af62-b400e3830f22 service nova] Releasing lock "refresh_cache-5bc17e5d-3ae1-474d-bd49-71c60f3e46be" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188285.2458289, 2462cd5c-8c3b-49e6-82a9-6539c57edb1e => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:18:20 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] VM Stopped (Lifecycle Event)
Aug 16 12:18:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6dd3d69f-7cf9-4264-bbf7-68956986d13c None None] [instance: 2462cd5c-8c3b-49e6-82a9-6539c57edb1e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'flavor' on Instance uuid 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:20 user nova-compute[73520]: INFO nova.compute.manager [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Attaching volume 41f191e0-c282-4ab3-ba32-c95c68d30992 to /dev/vdb
Aug 16 12:18:20 user nova-compute[73520]: DEBUG os_brick.utils [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2b9aa5-f251-49bd-ad62-035ab5161a68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4dd724-4a94-4743-8749-bc2fd4ee203f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0310339-107a-4006-ad2f-5296f5173c8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f9947-f3bb-4196-9408-787c58eaab57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:18:20 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:18:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8783e17-4aa5-4f2d-b660-33f996bbda2b]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:18:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:18:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:18:21 user nova-compute[73520]: DEBUG os_brick.utils [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:18:21 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Updating existing volume attachment record: 1ae96380-1478-4f88-8c44-7214996e0d3f {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:18:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:27 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:28 user nova-compute[73520]: INFO nova.compute.manager [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Terminating instance
Aug 16 12:18:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:18:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Instance destroyed successfully.
Aug 16 12:18:29 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lazy-loading 'resources' on Instance uuid 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:16:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-950633164',display_name='tempest-VolumesAdminNegativeTest-server-950633164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-950633164',id=14,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:16:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='380e448092474d8d85b91b431adf9ee6',ramdisk_id='',reservation_id='r-64bz7fr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1985198008',owner_user_name='tempest-VolumesAdminNegativeTest-1985198008-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:16:35Z,user_data=None,user_id='fb190d4184a94bdd92b148d65dec3956',uuid=0ae9104d-5351-4822-a4c2-6bc8e7f2ab35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1939e02-35f3-40fa-812b-d622a7a64617", "address": "fa:16:3e:8f:19:54", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1939e02-35", "ovs_interfaceid": "f1939e02-35f3-40fa-812b-d622a7a64617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Converting VIF {"id": "f1939e02-35f3-40fa-812b-d622a7a64617", "address": "fa:16:3e:8f:19:54", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1939e02-35", "ovs_interfaceid": "f1939e02-35f3-40fa-812b-d622a7a64617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:19:54,bridge_name='br-int',has_traffic_filtering=True,id=f1939e02-35f3-40fa-812b-d622a7a64617,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1939e02-35') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG os_vif [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:19:54,bridge_name='br-int',has_traffic_filtering=True,id=f1939e02-35f3-40fa-812b-d622a7a64617,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1939e02-35') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1939e02-35, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:29 user nova-compute[73520]: INFO os_vif [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:19:54,bridge_name='br-int',has_traffic_filtering=True,id=f1939e02-35f3-40fa-812b-d622a7a64617,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1939e02-35')
Aug 16 12:18:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Deleting instance files /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35_del
Aug 16 12:18:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Deletion of /opt/stack/data/nova/instances/0ae9104d-5351-4822-a4c2-6bc8e7f2ab35_del complete
Aug 16 12:18:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-845b0734-74bd-46dd-9944-6483515ea4fe req-688d622a-e8c2-4b14-ab9f-edf05183fc4e service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Received event network-vif-unplugged-f1939e02-35f3-40fa-812b-d622a7a64617 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-845b0734-74bd-46dd-9944-6483515ea4fe req-688d622a-e8c2-4b14-ab9f-edf05183fc4e service nova] Acquiring lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-845b0734-74bd-46dd-9944-6483515ea4fe req-688d622a-e8c2-4b14-ab9f-edf05183fc4e service nova] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-845b0734-74bd-46dd-9944-6483515ea4fe req-688d622a-e8c2-4b14-ab9f-edf05183fc4e service nova] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-845b0734-74bd-46dd-9944-6483515ea4fe req-688d622a-e8c2-4b14-ab9f-edf05183fc4e service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] No waiting events found dispatching network-vif-unplugged-f1939e02-35f3-40fa-812b-d622a7a64617 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-845b0734-74bd-46dd-9944-6483515ea4fe req-688d622a-e8c2-4b14-ab9f-edf05183fc4e service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Received event network-vif-unplugged-f1939e02-35f3-40fa-812b-d622a7a64617 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:18:29 user nova-compute[73520]: INFO nova.compute.manager [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 16 12:18:29 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:18:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:30 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:18:30 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Took 1.04 seconds to deallocate network for instance.
Aug 16 12:18:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-c4f8ed1e-3b1a-4b5b-a8a4-091bdb1d8aeb req-2eb931ba-e04f-470e-a2b1-4eecf9ab65ee service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Received event network-vif-deleted-f1939e02-35f3-40fa-812b-d622a7a64617 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:30 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:31 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:18:31 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:18:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:31 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Deleted allocations for instance 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35
Aug 16 12:18:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d32e9123-d22c-479a-9d34-c1914b5f3237 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.691s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-30a279f8-7d47-4b07-8da8-813bc19e67b3 req-d3aae986-0427-438f-968a-959ad454484c service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Received event network-vif-plugged-f1939e02-35f3-40fa-812b-d622a7a64617 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-30a279f8-7d47-4b07-8da8-813bc19e67b3 req-d3aae986-0427-438f-968a-959ad454484c service nova] Acquiring lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-30a279f8-7d47-4b07-8da8-813bc19e67b3 req-d3aae986-0427-438f-968a-959ad454484c service nova] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-30a279f8-7d47-4b07-8da8-813bc19e67b3 req-d3aae986-0427-438f-968a-959ad454484c service nova] Lock "0ae9104d-5351-4822-a4c2-6bc8e7f2ab35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-30a279f8-7d47-4b07-8da8-813bc19e67b3 req-d3aae986-0427-438f-968a-959ad454484c service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] No waiting events found dispatching network-vif-plugged-f1939e02-35f3-40fa-812b-d622a7a64617 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:31 user nova-compute[73520]: WARNING nova.compute.manager [req-30a279f8-7d47-4b07-8da8-813bc19e67b3 req-d3aae986-0427-438f-968a-959ad454484c service nova] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Received unexpected event network-vif-plugged-f1939e02-35f3-40fa-812b-d622a7a64617 for instance with vm_state deleted and task_state None.
Aug 16 12:18:31 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:31 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:31 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGcmdoMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:18:33 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:18:33 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:18:33 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ba0150-a6e3-42a0-910c-a4b3fd8623ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:18:33 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e064e2-f608-4d36-81c5-306ae312e897]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992] added
Aug 16 12:18:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a68cbca-5034-4ae0-a5ba-3a67b7d73f91]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d499e4-f5fb-47d0-8b1b-ebdd1717deb5]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGcmdoMA {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGcmdoMA" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b7aca1-45de-4aae-84ca-0652a57bd5dd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wGcmdoMA'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[037b7bce-4626-43b8-9766-bafc8a2c0df6]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b122c63-1487-4dd1-a9cb-f9ce6b1d043a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a175d3d1-389e-4eb4-8732-fe003ad9a99f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260]
Aug 16 12:18:33 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260] successful.
Aug 16 12:18:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[da60e63b-61db-408d-ab34-46c9d7da891b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16e0951-e346-47e0-9143-ba32b3c7913b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:33 user nova-compute[73520]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:18:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:33 user nova-compute[73520]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:18:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[413c2dc9-140f-4c70-b986-29c002c71f15]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGcmdoMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "636510f6-acfa-4705-bfb1-03df3f9297be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "636510f6-acfa-4705-bfb1-03df3f9297be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:33 user nova-compute[73520]: INFO nova.compute.manager [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Terminating instance
Aug 16 12:18:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG nova.compute.manager [req-477f2825-115e-49ec-95d9-60e6330be112 req-de0e6f89-69ad-439e-862d-81fb944236fe service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Received event network-vif-unplugged-8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-477f2825-115e-49ec-95d9-60e6330be112 req-de0e6f89-69ad-439e-862d-81fb944236fe service nova] Acquiring lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-477f2825-115e-49ec-95d9-60e6330be112 req-de0e6f89-69ad-439e-862d-81fb944236fe service nova] Lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-477f2825-115e-49ec-95d9-60e6330be112 req-de0e6f89-69ad-439e-862d-81fb944236fe service nova] Lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG nova.compute.manager [req-477f2825-115e-49ec-95d9-60e6330be112 req-de0e6f89-69ad-439e-862d-81fb944236fe service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] No waiting events found dispatching network-vif-unplugged-8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG nova.compute.manager [req-477f2825-115e-49ec-95d9-60e6330be112 req-de0e6f89-69ad-439e-862d-81fb944236fe service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Received event network-vif-unplugged-8752a2b2-4922-4822-ad90-f0a98e749b9f for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Instance destroyed successfully.
Aug 16 12:18:34 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'resources' on Instance uuid 636510f6-acfa-4705-bfb1-03df3f9297be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-889920580',display_name='tempest-AttachVolumeNegativeTest-server-889920580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-889920580',id=4,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU68gMjUMrrFGYyL6G+bCKIrc9K1Hm/bQaeFEEcUHEKz0b7+Nsl04EHx12Pf0ZOjvPRHhA2XGz5Mn8jPbfMUg72MUtAH8VRQHZXPkzxgixcXnCOSzZfft+jgW8lUUNBdQ==',key_name='tempest-keypair-1325007206',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:12:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1059841e2ee04ca4870497a1ec60bcaa',ramdisk_id='',reservation_id='r-m2e9w7uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1618912538',owner_user_name='tempest-AttachVolumeNegativeTest-1618912538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6426c917725745038fdb1d03fec4a2fd',uuid=636510f6-acfa-4705-bfb1-03df3f9297be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "address": "fa:16:3e:da:67:8e", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8752a2b2-49", "ovs_interfaceid": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converting VIF {"id": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "address": "fa:16:3e:da:67:8e", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8752a2b2-49", "ovs_interfaceid": "8752a2b2-4922-4822-ad90-f0a98e749b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:67:8e,bridge_name='br-int',has_traffic_filtering=True,id=8752a2b2-4922-4822-ad90-f0a98e749b9f,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8752a2b2-49') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG os_vif [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:67:8e,bridge_name='br-int',has_traffic_filtering=True,id=8752a2b2-4922-4822-ad90-f0a98e749b9f,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8752a2b2-49') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8752a2b2-49, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:18:34 user nova-compute[73520]: INFO os_vif [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:67:8e,bridge_name='br-int',has_traffic_filtering=True,id=8752a2b2-4922-4822-ad90-f0a98e749b9f,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8752a2b2-49')
Aug 16 12:18:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Deleting instance files /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be_del
Aug 16 12:18:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Deletion of /opt/stack/data/nova/instances/636510f6-acfa-4705-bfb1-03df3f9297be_del complete
Aug 16 12:18:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.479s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '26635626665326562', 'path': '/dev/sdc'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635626665326562', 'path': '/dev/sdc'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'flavor' on Instance uuid 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:18:34 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:18:34 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:18:34 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:18:34 user nova-compute[73520]:   <serial>41f191e0-c282-4ab3-ba32-c95c68d30992</serial>
Aug 16 12:18:34 user nova-compute[73520]: </disk>
Aug 16 12:18:34 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:35 user nova-compute[73520]: INFO nova.compute.manager [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 16 12:18:35 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:18:35 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:18:35 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:18:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:18:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:18:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No VIF found with MAC fa:16:3e:38:2a:c6, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:18:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b706d915-17c5-49b8-97f9-7aee0e5a245f tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.884s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:36 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:18:36 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7760MB free_disk=25.58637237548828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 636510f6-acfa-4705-bfb1-03df3f9297be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1e35c753-7af1-4047-ad06-8b5755207b8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance b58731e0-399d-4f8d-84b8-af12a46cf87f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing inventories for resource provider 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating ProviderTree inventory for provider 70dde5f5-9594-47c3-954e-598dd3089747 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing aggregate associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, aggregates: None {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:18:36 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Took 1.73 seconds to deallocate network for instance.
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-bb1f29b8-0f18-4a21-8a4e-178382f3a692 req-99c248c3-9a9c-4e01-ae7c-dbd351cb18b6 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Received event network-vif-plugged-8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bb1f29b8-0f18-4a21-8a4e-178382f3a692 req-99c248c3-9a9c-4e01-ae7c-dbd351cb18b6 service nova] Acquiring lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bb1f29b8-0f18-4a21-8a4e-178382f3a692 req-99c248c3-9a9c-4e01-ae7c-dbd351cb18b6 service nova] Lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bb1f29b8-0f18-4a21-8a4e-178382f3a692 req-99c248c3-9a9c-4e01-ae7c-dbd351cb18b6 service nova] Lock "636510f6-acfa-4705-bfb1-03df3f9297be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-bb1f29b8-0f18-4a21-8a4e-178382f3a692 req-99c248c3-9a9c-4e01-ae7c-dbd351cb18b6 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] No waiting events found dispatching network-vif-plugged-8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:36 user nova-compute[73520]: WARNING nova.compute.manager [req-bb1f29b8-0f18-4a21-8a4e-178382f3a692 req-99c248c3-9a9c-4e01-ae7c-dbd351cb18b6 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Received unexpected event network-vif-plugged-8752a2b2-4922-4822-ad90-f0a98e749b9f for instance with vm_state active and task_state deleting.
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-763ded1f-b8c4-4c6d-873d-a4b51ad0694a req-dc848784-ae84-4d31-b87a-866eacd02820 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Received event network-vif-deleted-8752a2b2-4922-4822-ad90-f0a98e749b9f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:36 user nova-compute[73520]: INFO nova.compute.manager [req-763ded1f-b8c4-4c6d-873d-a4b51ad0694a req-dc848784-ae84-4d31-b87a-866eacd02820 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Neutron deleted interface 8752a2b2-4922-4822-ad90-f0a98e749b9f; detaching it from the instance and deleting it from the info cache
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.network.neutron [req-763ded1f-b8c4-4c6d-873d-a4b51ad0694a req-dc848784-ae84-4d31-b87a-866eacd02820 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing trait associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-763ded1f-b8c4-4c6d-873d-a4b51ad0694a req-dc848784-ae84-4d31-b87a-866eacd02820 service nova] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Detach interface failed, port_id=8752a2b2-4922-4822-ad90-f0a98e749b9f, reason: Instance 636510f6-acfa-4705-bfb1-03df3f9297be could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:36 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:18:37 user nova-compute[73520]: INFO nova.compute.manager [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Rebuilding instance
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.755s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.239s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "14e89425-93b9-4005-bee2-2b7cc871ee13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] There are 0 instances to clean {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'pci_requests' on Instance uuid 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'resources' on Instance uuid 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'migration_context' on Instance uuid 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73520) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.229s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:18:37 user nova-compute[73520]: INFO nova.compute.claims [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Claim successful on node user
Aug 16 12:18:37 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Deleted allocations for instance 636510f6-acfa-4705-bfb1-03df3f9297be
Aug 16 12:18:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f58be03e-0566-4520-a5d2-e845962ea522 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "636510f6-acfa-4705-bfb1-03df3f9297be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.636s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:18:37 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:18:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:18:38 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Creating image(s)
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "/opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "/opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "/opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG nova.policy [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d1e9417253f43b482e8ee5b3109a697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3756b80f2243dca0b31ffea7438b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:18:38 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Instance destroyed successfully.
Aug 16 12:18:38 user nova-compute[73520]: INFO nova.compute.manager [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Detaching volume 41f191e0-c282-4ab3-ba32-c95c68d30992
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.201s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: INFO nova.virt.block_device [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Attempting to driver detach volume 41f191e0-c282-4ab3-ba32-c95c68d30992 from mountpoint /dev/vdb
Aug 16 12:18:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Attempting to detach device vdb from instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:18:38 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:18:38 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:18:38 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:18:38 user nova-compute[73520]:   <serial>41f191e0-c282-4ab3-ba32-c95c68d30992</serial>
Aug 16 12:18:38 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:18:38 user nova-compute[73520]: </disk>
Aug 16 12:18:38 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Successfully detached device vdb from instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be from the persistent domain config.
Aug 16 12:18:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGcmdoMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:18:38 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk 1073741824" returned: 0 in 0.057s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db8d096-651d-4863-ac6a-9c76c3a33095]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[18699e0e-0c5c-460c-9eb8-993d9ebbdd2d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:38 user nova-compute[73520]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:18:38 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:38 user nova-compute[73520]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:18:38 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c69a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992'): ({'sdc'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Removing single pathed devices sdc {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20b1df2-ecba-4d0c-8f1f-cadc50a0f7f1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3325026-14e5-45bb-9051-ab631243b4e8]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flushing IO for device /dev/sdc {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ef8ddc-bb7b-467e-8779-31e6391dfb70]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.207s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca69d72f-3812-4fa5-bd17-465a3abed095]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:38 user nova-compute[73520]: INFO nova.compute.manager [None req-635bb56a-8718-47e5-99fe-83b927ecdce6 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Unrescuing
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-635bb56a-8718-47e5-99fe-83b927ecdce6 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-635bb56a-8718-47e5-99fe-83b927ecdce6 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquired lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-635bb56a-8718-47e5-99fe-83b927ecdce6 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89c505d-a68c-4e17-8538-e455df6b9a07]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8047c011-5ae2-4702-bcf3-9f0cecad03d9]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260]
Aug 16 12:18:38 user nova-compute[73520]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260] successful.
Aug 16 12:18:38 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2617e7-c232-4d4d-a4e4-7490ae7ba63b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] <== disconnect_volume: return (422ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Cannot resize image /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG nova.objects.instance [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'migration_context' on Instance uuid 14e89425-93b9-4005-bee2-2b7cc871ee13 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Ensure instance console log exists: /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Successfully created port: f959bb38-4830-456d-bd98-dd621fdb5420 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:39 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Instance destroyed successfully.
Aug 16 12:18:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1602865874',display_name='tempest-ServerActionsTestOtherA-server-326484734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1602865874',id=15,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWDmy7Y42O8TTQkPPhvFapOqey2yzr7+HunIIo/9lzfe8rKUqepoW4Do3+MfNrt5xHtu6/gJraSlGY+a2w8Nv7CvDCfHvcSHnTbLC47JDVntO2l274nBETm3y7rR4CR0A==',key_name='tempest-keypair-305970178',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:16:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-lgydxk2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=5bc17e5d-3ae1-474d-bd49-71c60f3e46be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG os_vif [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27a8f0eb-62, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:18:39 user nova-compute[73520]: INFO os_vif [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62')
Aug 16 12:18:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGcmdoMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:18:39 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 12:18:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cd12a8-8c2b-4c69-bede-57da1db7c324]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc209d0d-910b-49a7-ab4d-2de90cdadc7c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:40 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:40 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c34c5e0>, {}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Disconnecting from: [] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] <== disconnect_volume: return (65ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:18:40 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Deleting instance files /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be_del
Aug 16 12:18:40 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Deletion of /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be_del complete
Aug 16 12:18:40 user nova-compute[73520]: INFO nova.virt.block_device [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Booting with volume 41f191e0-c282-4ab3-ba32-c95c68d30992 at /dev/vdb
Aug 16 12:18:40 user nova-compute[73520]: DEBUG os_brick.utils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d08bed9-f620-4335-80eb-2743948fc22d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-9518d41b-e6ca-4387-9103-9fe8fda66fba req-9329d506-bc2c-43c9-a97f-2406c3e95f7a service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received event network-vif-unplugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9518d41b-e6ca-4387-9103-9fe8fda66fba req-9329d506-bc2c-43c9-a97f-2406c3e95f7a service nova] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9518d41b-e6ca-4387-9103-9fe8fda66fba req-9329d506-bc2c-43c9-a97f-2406c3e95f7a service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9518d41b-e6ca-4387-9103-9fe8fda66fba req-9329d506-bc2c-43c9-a97f-2406c3e95f7a service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-9518d41b-e6ca-4387-9103-9fe8fda66fba req-9329d506-bc2c-43c9-a97f-2406c3e95f7a service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] No waiting events found dispatching network-vif-unplugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:40 user nova-compute[73520]: WARNING nova.compute.manager [req-9518d41b-e6ca-4387-9103-9fe8fda66fba req-9329d506-bc2c-43c9-a97f-2406c3e95f7a service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received unexpected event network-vif-unplugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fc46de-8677-44af-9466-eb221719a309]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee86bc0-e4b7-4220-8f41-79a592e380e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faa3985-7238-453f-ab16-adb03ef5f85b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:18:40 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bd63dc-6fc1-4646-9880-d2cef201759a]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG os_brick.utils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Updating existing volume attachment record: f358fd5a-81c8-4373-8a47-94816f7f66a1 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG nova.network.neutron [None req-635bb56a-8718-47e5-99fe-83b927ecdce6 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updating instance_info_cache with network_info: [{"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-635bb56a-8718-47e5-99fe-83b927ecdce6 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Releasing lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG nova.objects.instance [None req-635bb56a-8718-47e5-99fe-83b927ecdce6 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lazy-loading 'flavor' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-1e2ffd26-d605-47db-a008-381056b94526 req-8d359c32-63d1-4e24-88eb-6d9150347fae service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-unplugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1e2ffd26-d605-47db-a008-381056b94526 req-8d359c32-63d1-4e24-88eb-6d9150347fae service nova] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1e2ffd26-d605-47db-a008-381056b94526 req-8d359c32-63d1-4e24-88eb-6d9150347fae service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1e2ffd26-d605-47db-a008-381056b94526 req-8d359c32-63d1-4e24-88eb-6d9150347fae service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-1e2ffd26-d605-47db-a008-381056b94526 req-8d359c32-63d1-4e24-88eb-6d9150347fae service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] No waiting events found dispatching network-vif-unplugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:41 user nova-compute[73520]: WARNING nova.compute.manager [req-1e2ffd26-d605-47db-a008-381056b94526 req-8d359c32-63d1-4e24-88eb-6d9150347fae service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received unexpected event network-vif-unplugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:18:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:41 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Instance destroyed successfully.
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Successfully updated port: f959bb38-4830-456d-bd98-dd621fdb5420 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquired lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-b019031b-4cac-4289-94e8-5b770d5bf687 req-fbf42b9a-192b-4814-8c8d-487dbe722f7e service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Received event network-changed-f959bb38-4830-456d-bd98-dd621fdb5420 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-b019031b-4cac-4289-94e8-5b770d5bf687 req-fbf42b9a-192b-4814-8c8d-487dbe722f7e service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Refreshing instance network info cache due to event network-changed-f959bb38-4830-456d-bd98-dd621fdb5420. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b019031b-4cac-4289-94e8-5b770d5bf687 req-fbf42b9a-192b-4814-8c8d-487dbe722f7e service nova] Acquiring lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-b25dc3d1-3eef-4d63-893b-5632ad35cbf0 req-e0c3531c-fa81-46fa-90b9-29eaa7c137bf service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received event network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b25dc3d1-3eef-4d63-893b-5632ad35cbf0 req-e0c3531c-fa81-46fa-90b9-29eaa7c137bf service nova] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b25dc3d1-3eef-4d63-893b-5632ad35cbf0 req-e0c3531c-fa81-46fa-90b9-29eaa7c137bf service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b25dc3d1-3eef-4d63-893b-5632ad35cbf0 req-e0c3531c-fa81-46fa-90b9-29eaa7c137bf service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-b25dc3d1-3eef-4d63-893b-5632ad35cbf0 req-e0c3531c-fa81-46fa-90b9-29eaa7c137bf service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] No waiting events found dispatching network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:42 user nova-compute[73520]: WARNING nova.compute.manager [req-b25dc3d1-3eef-4d63-893b-5632ad35cbf0 req-e0c3531c-fa81-46fa-90b9-29eaa7c137bf service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received unexpected event network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 16 12:18:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Updating instance_info_cache with network_info: [{"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Releasing lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Instance network_info: |[{"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b019031b-4cac-4289-94e8-5b770d5bf687 req-fbf42b9a-192b-4814-8c8d-487dbe722f7e service nova] Acquired lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.network.neutron [req-b019031b-4cac-4289-94e8-5b770d5bf687 req-fbf42b9a-192b-4814-8c8d-487dbe722f7e service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Refreshing network info cache for port f959bb38-4830-456d-bd98-dd621fdb5420 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Start _get_guest_xml network_info=[{"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:18:42 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:18:42 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-324983927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-324983927',id=17,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-hvh4o0w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:18:38Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=14e89425-93b9-4005-bee2-2b7cc871ee13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:97:ea,bridge_name='br-int',has_traffic_filtering=True,id=f959bb38-4830-456d-bd98-dd621fdb5420,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf959bb38-48') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.objects.instance [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'pci_devices' on Instance uuid 14e89425-93b9-4005-bee2-2b7cc871ee13 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:18:42 user nova-compute[73520]:   <uuid>14e89425-93b9-4005-bee2-2b7cc871ee13</uuid>
Aug 16 12:18:42 user nova-compute[73520]:   <name>instance-00000011</name>
Aug 16 12:18:42 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:18:42 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:18:42 user nova-compute[73520]:   <metadata>
Aug 16 12:18:42 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:18:42 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:18:42 user nova-compute[73520]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-324983927</nova:name>
Aug 16 12:18:42 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:18:42</nova:creationTime>
Aug 16 12:18:42 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:18:42 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:18:42 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:18:42 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:18:42 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:18:42 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:18:42 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:18:42 user nova-compute[73520]:       <nova:owner>
Aug 16 12:18:42 user nova-compute[73520]:         <nova:user uuid="3d1e9417253f43b482e8ee5b3109a697">tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member</nova:user>
Aug 16 12:18:42 user nova-compute[73520]:         <nova:project uuid="4d3756b80f2243dca0b31ffea7438b5d">tempest-ServerBootFromVolumeStableRescueTest-1104312883</nova:project>
Aug 16 12:18:42 user nova-compute[73520]:       </nova:owner>
Aug 16 12:18:42 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:18:42 user nova-compute[73520]:       <nova:ports>
Aug 16 12:18:42 user nova-compute[73520]:         <nova:port uuid="f959bb38-4830-456d-bd98-dd621fdb5420">
Aug 16 12:18:42 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 12:18:42 user nova-compute[73520]:         </nova:port>
Aug 16 12:18:42 user nova-compute[73520]:       </nova:ports>
Aug 16 12:18:42 user nova-compute[73520]:     </nova:instance>
Aug 16 12:18:42 user nova-compute[73520]:   </metadata>
Aug 16 12:18:42 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:18:42 user nova-compute[73520]:     <system>
Aug 16 12:18:42 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:18:42 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:18:42 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:18:42 user nova-compute[73520]:       <entry name="serial">14e89425-93b9-4005-bee2-2b7cc871ee13</entry>
Aug 16 12:18:42 user nova-compute[73520]:       <entry name="uuid">14e89425-93b9-4005-bee2-2b7cc871ee13</entry>
Aug 16 12:18:42 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:18:42 user nova-compute[73520]:     </system>
Aug 16 12:18:42 user nova-compute[73520]:   </sysinfo>
Aug 16 12:18:42 user nova-compute[73520]:   <os>
Aug 16 12:18:42 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:18:42 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:18:42 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:18:42 user nova-compute[73520]:   </os>
Aug 16 12:18:42 user nova-compute[73520]:   <features>
Aug 16 12:18:42 user nova-compute[73520]:     <acpi/>
Aug 16 12:18:42 user nova-compute[73520]:     <apic/>
Aug 16 12:18:42 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:18:42 user nova-compute[73520]:   </features>
Aug 16 12:18:42 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:18:42 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:18:42 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:18:42 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:18:42 user nova-compute[73520]:   </clock>
Aug 16 12:18:42 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:18:42 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:18:42 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:18:42 user nova-compute[73520]:   </cpu>
Aug 16 12:18:42 user nova-compute[73520]:   <devices>
Aug 16 12:18:42 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:18:42 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:18:42 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk"/>
Aug 16 12:18:42 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:18:42 user nova-compute[73520]:     </disk>
Aug 16 12:18:42 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:18:42 user nova-compute[73520]:       <mac address="fa:16:3e:5b:97:ea"/>
Aug 16 12:18:42 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:18:42 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:18:42 user nova-compute[73520]:       <target dev="tapf959bb38-48"/>
Aug 16 12:18:42 user nova-compute[73520]:     </interface>
Aug 16 12:18:42 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:18:42 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/console.log" append="off"/>
Aug 16 12:18:42 user nova-compute[73520]:     </serial>
Aug 16 12:18:42 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:18:42 user nova-compute[73520]:     <video>
Aug 16 12:18:42 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:18:42 user nova-compute[73520]:     </video>
Aug 16 12:18:42 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:18:42 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:18:42 user nova-compute[73520]:     </rng>
Aug 16 12:18:42 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:18:42 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:18:42 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:18:42 user nova-compute[73520]:     </memballoon>
Aug 16 12:18:42 user nova-compute[73520]:   </devices>
Aug 16 12:18:42 user nova-compute[73520]: </domain>
Aug 16 12:18:42 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-324983927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-324983927',id=17,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-hvh4o0w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:18:38Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=14e89425-93b9-4005-bee2-2b7cc871ee13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:97:ea,bridge_name='br-int',has_traffic_filtering=True,id=f959bb38-4830-456d-bd98-dd621fdb5420,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf959bb38-48') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG os_vif [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:97:ea,bridge_name='br-int',has_traffic_filtering=True,id=f959bb38-4830-456d-bd98-dd621fdb5420,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf959bb38-48') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf959bb38-48, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf959bb38-48, col_values=(('external_ids', {'iface-id': 'f959bb38-4830-456d-bd98-dd621fdb5420', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:97:ea', 'vm-uuid': '14e89425-93b9-4005-bee2-2b7cc871ee13'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:42 user nova-compute[73520]: INFO os_vif [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:97:ea,bridge_name='br-int',has_traffic_filtering=True,id=f959bb38-4830-456d-bd98-dd621fdb5420,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf959bb38-48')
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:18:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No VIF found with MAC fa:16:3e:5b:97:ea, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:18:43 user nova-compute[73520]: DEBUG nova.network.neutron [req-b019031b-4cac-4289-94e8-5b770d5bf687 req-fbf42b9a-192b-4814-8c8d-487dbe722f7e service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Updated VIF entry in instance network info cache for port f959bb38-4830-456d-bd98-dd621fdb5420. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:18:43 user nova-compute[73520]: DEBUG nova.network.neutron [req-b019031b-4cac-4289-94e8-5b770d5bf687 req-fbf42b9a-192b-4814-8c8d-487dbe722f7e service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Updating instance_info_cache with network_info: [{"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:18:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b019031b-4cac-4289-94e8-5b770d5bf687 req-fbf42b9a-192b-4814-8c8d-487dbe722f7e service nova] Releasing lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:18:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-changed-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Refreshing instance network info cache due to event network-changed-e7070f8b-1a15-4dad-8fac-bd4518007ed3. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:18:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] Acquiring lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:18:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] Acquired lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:18:43 user nova-compute[73520]: DEBUG nova.network.neutron [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Refreshing network info cache for port e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188309.5387952, 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:18:44 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] VM Stopped (Lifecycle Event)
Aug 16 12:18:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2990155c-2ce4-42e1-aa9a-84b6d51bbf99 None None] [instance: 0ae9104d-5351-4822-a4c2-6bc8e7f2ab35] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG nova.network.neutron [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updated VIF entry in instance network info cache for port e7070f8b-1a15-4dad-8fac-bd4518007ed3. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG nova.network.neutron [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updating instance_info_cache with network_info: [{"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] Releasing lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] No waiting events found dispatching network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:44 user nova-compute[73520]: WARNING nova.compute.manager [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received unexpected event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:18:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-changed-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Refreshing instance network info cache due to event network-changed-e7070f8b-1a15-4dad-8fac-bd4518007ed3. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] Acquiring lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] Acquired lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:18:44 user nova-compute[73520]: DEBUG nova.network.neutron [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Refreshing network info cache for port e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:18:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-cd4b334b-d7a6-48a3-9d5e-24c824495b45 req-adbacecf-6f0c-4857-9cde-0b3e3cb0d686 service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Received event network-vif-plugged-f959bb38-4830-456d-bd98-dd621fdb5420 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cd4b334b-d7a6-48a3-9d5e-24c824495b45 req-adbacecf-6f0c-4857-9cde-0b3e3cb0d686 service nova] Acquiring lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cd4b334b-d7a6-48a3-9d5e-24c824495b45 req-adbacecf-6f0c-4857-9cde-0b3e3cb0d686 service nova] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cd4b334b-d7a6-48a3-9d5e-24c824495b45 req-adbacecf-6f0c-4857-9cde-0b3e3cb0d686 service nova] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-cd4b334b-d7a6-48a3-9d5e-24c824495b45 req-adbacecf-6f0c-4857-9cde-0b3e3cb0d686 service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] No waiting events found dispatching network-vif-plugged-f959bb38-4830-456d-bd98-dd621fdb5420 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:45 user nova-compute[73520]: WARNING nova.compute.manager [req-cd4b334b-d7a6-48a3-9d5e-24c824495b45 req-adbacecf-6f0c-4857-9cde-0b3e3cb0d686 service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Received unexpected event network-vif-plugged-f959bb38-4830-456d-bd98-dd621fdb5420 for instance with vm_state building and task_state spawning.
Aug 16 12:18:45 user nova-compute[73520]: DEBUG nova.network.neutron [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updated VIF entry in instance network info cache for port e7070f8b-1a15-4dad-8fac-bd4518007ed3. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:18:45 user nova-compute[73520]: DEBUG nova.network.neutron [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updating instance_info_cache with network_info: [{"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:18:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d759bb8-3c62-45b3-92fa-03cfc9854e7e req-e11b2699-2168-423a-8eba-00856cc90f5f service nova] Releasing lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:18:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Removed pending event for 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a due to event {{(pid=73520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188327.567629, 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:18:47 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] VM Resumed (Lifecycle Event)
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-635bb56a-8718-47e5-99fe-83b927ecdce6 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-f18ff6fa-8523-41c4-afff-b19f914d1313 req-328544a3-f771-4573-adf0-edb1c7152f37 service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Received event network-vif-plugged-f959bb38-4830-456d-bd98-dd621fdb5420 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f18ff6fa-8523-41c4-afff-b19f914d1313 req-328544a3-f771-4573-adf0-edb1c7152f37 service nova] Acquiring lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f18ff6fa-8523-41c4-afff-b19f914d1313 req-328544a3-f771-4573-adf0-edb1c7152f37 service nova] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f18ff6fa-8523-41c4-afff-b19f914d1313 req-328544a3-f771-4573-adf0-edb1c7152f37 service nova] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-f18ff6fa-8523-41c4-afff-b19f914d1313 req-328544a3-f771-4573-adf0-edb1c7152f37 service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] No waiting events found dispatching network-vif-plugged-f959bb38-4830-456d-bd98-dd621fdb5420 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:47 user nova-compute[73520]: WARNING nova.compute.manager [req-f18ff6fa-8523-41c4-afff-b19f914d1313 req-328544a3-f771-4573-adf0-edb1c7152f37 service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Received unexpected event network-vif-plugged-f959bb38-4830-456d-bd98-dd621fdb5420 for instance with vm_state building and task_state spawning.
Aug 16 12:18:47 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188327.5695136, 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:18:47 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] VM Started (Lifecycle Event)
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:18:47 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Instance spawned successfully.
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188327.6786027, 14e89425-93b9-4005-bee2-2b7cc871ee13 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:18:47 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] VM Resumed (Lifecycle Event)
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:18:47 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188327.6791298, 14e89425-93b9-4005-bee2-2b7cc871ee13 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:18:47 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] VM Started (Lifecycle Event)
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:18:47 user nova-compute[73520]: INFO nova.compute.manager [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Took 9.73 seconds to spawn the instance on the hypervisor.
Aug 16 12:18:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:18:47 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:18:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:47 user nova-compute[73520]: INFO nova.compute.manager [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Took 10.68 seconds to build instance.
Aug 16 12:18:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a0d56ccd-3bc6-4cc1-bb8d-1aa16c2591fc tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.812s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-bf78e979-1df9-4456-bc7e-4fcb6211cad6 req-2a136704-84f6-4353-985b-4c4d6358705c service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bf78e979-1df9-4456-bc7e-4fcb6211cad6 req-2a136704-84f6-4353-985b-4c4d6358705c service nova] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bf78e979-1df9-4456-bc7e-4fcb6211cad6 req-2a136704-84f6-4353-985b-4c4d6358705c service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bf78e979-1df9-4456-bc7e-4fcb6211cad6 req-2a136704-84f6-4353-985b-4c4d6358705c service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-bf78e979-1df9-4456-bc7e-4fcb6211cad6 req-2a136704-84f6-4353-985b-4c4d6358705c service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] No waiting events found dispatching network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:48 user nova-compute[73520]: WARNING nova.compute.manager [req-bf78e979-1df9-4456-bc7e-4fcb6211cad6 req-2a136704-84f6-4353-985b-4c4d6358705c service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received unexpected event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 for instance with vm_state active and task_state None.
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:18:49 user nova-compute[73520]: WARNING nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] While synchronizing instance power states, found 6 instances in the database and 5 instances on the hypervisor.
Aug 16 12:18:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 443357b7-2fc9-4ac7-8fce-7dc2bede4369 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 1e35c753-7af1-4047-ad06-8b5755207b8e {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 14e89425-93b9-4005-bee2-2b7cc871ee13 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "1e35c753-7af1-4047-ad06-8b5755207b8e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:49 user nova-compute[73520]: INFO nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "14e89425-93b9-4005-bee2-2b7cc871ee13" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:49 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188314.8119156, 636510f6-acfa-4705-bfb1-03df3f9297be => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:18:49 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] VM Stopped (Lifecycle Event)
Aug 16 12:18:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-5fefa8b7-8116-4f72-b816-116790f1a343 None None] [instance: 636510f6-acfa-4705-bfb1-03df3f9297be] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:18:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-d5eedcd0-3367-4105-ba10-52625036c7c5 req-f5c3a67b-37d8-41bb-b7e3-2b478edc710a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d5eedcd0-3367-4105-ba10-52625036c7c5 req-f5c3a67b-37d8-41bb-b7e3-2b478edc710a service nova] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d5eedcd0-3367-4105-ba10-52625036c7c5 req-f5c3a67b-37d8-41bb-b7e3-2b478edc710a service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d5eedcd0-3367-4105-ba10-52625036c7c5 req-f5c3a67b-37d8-41bb-b7e3-2b478edc710a service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-d5eedcd0-3367-4105-ba10-52625036c7c5 req-f5c3a67b-37d8-41bb-b7e3-2b478edc710a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] No waiting events found dispatching network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:50 user nova-compute[73520]: WARNING nova.compute.manager [req-d5eedcd0-3367-4105-ba10-52625036c7c5 req-f5c3a67b-37d8-41bb-b7e3-2b478edc710a service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received unexpected event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 for instance with vm_state active and task_state None.
Aug 16 12:18:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188318.1061256, 5bc17e5d-3ae1-474d-bd49-71c60f3e46be => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:18:53 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] VM Stopped (Lifecycle Event)
Aug 16 12:18:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-03a37567-edde-4f72-81c3-33a3c2680623 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:18:53 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Creating image(s)
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "/opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "/opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.228s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.203s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk 1073741824" returned: 0 in 0.076s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.224s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:18:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Cannot resize image /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Ensure instance console log exists: /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Start _get_guest_xml network_info=[{"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGcmdoMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5bc17e5d-3ae1-474d-bd49-71c60f3e46be', 'attached_at': '', 'detached_at': '', 'volume_id': '41f191e0-c282-4ab3-ba32-c95c68d30992', 'serial': '41f191e0-c282-4ab3-ba32-c95c68d30992'}, 'attachment_id': 'f358fd5a-81c8-4373-8a47-94816f7f66a1', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:18:54 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 12:18:54 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGcmdoMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:18:54 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:18:54 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:18:54 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fe412a-be4e-401d-8520-14a49bc9dcc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:18:54 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f54672-266e-40a2-a62f-ef7c20d31a8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992] added
Aug 16 12:18:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b31fec-129a-4075-9662-15100f526ade]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccf0346-f75d-4421-abda-4348120e9fda]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGcmdoMA {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGcmdoMA" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a6f9af-51d8-4643-a569-0d4c7c6fb661]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wGcmdoMA'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[698be175-177d-44f6-894f-134e3387c0d1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[45828100-581a-4a9d-9a8a-ab83ec6a9eae]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d925a5a-ba42-47e0-a9c8-ff8a3c77d37d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260]
Aug 16 12:18:54 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260] successful.
Aug 16 12:18:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa30f7f-890f-42cf-acd3-f529fcd461bc]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23a7e09-e265-4985-b284-42883d6e16a3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:54 user nova-compute[73520]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:18:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:18:54 user nova-compute[73520]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:18:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.048s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cb1d34-8f75-4836-9a13-68de59054e7f]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:18:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGcmdoMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '26635626665326562', 'path': '/dev/sdc'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635626665326562', 'path': '/dev/sdc'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1602865874',display_name='tempest-ServerActionsTestOtherA-server-326484734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1602865874',id=15,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWDmy7Y42O8TTQkPPhvFapOqey2yzr7+HunIIo/9lzfe8rKUqepoW4Do3+MfNrt5xHtu6/gJraSlGY+a2w8Nv7CvDCfHvcSHnTbLC47JDVntO2l274nBETm3y7rR4CR0A==',key_name='tempest-keypair-305970178',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:16:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-lgydxk2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:18:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=5bc17e5d-3ae1-474d-bd49-71c60f3e46be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:18:55 user nova-compute[73520]:   <uuid>5bc17e5d-3ae1-474d-bd49-71c60f3e46be</uuid>
Aug 16 12:18:55 user nova-compute[73520]:   <name>instance-0000000f</name>
Aug 16 12:18:55 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:18:55 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:18:55 user nova-compute[73520]:   <metadata>
Aug 16 12:18:55 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:18:55 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:18:55 user nova-compute[73520]:       <nova:name>tempest-ServerActionsTestOtherA-server-326484734</nova:name>
Aug 16 12:18:55 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:18:54</nova:creationTime>
Aug 16 12:18:55 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:18:55 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:18:55 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:18:55 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:18:55 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:18:55 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:18:55 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:18:55 user nova-compute[73520]:       <nova:owner>
Aug 16 12:18:55 user nova-compute[73520]:         <nova:user uuid="d2495e37a99546deb000789aac42ed34">tempest-ServerActionsTestOtherA-294187005-project-member</nova:user>
Aug 16 12:18:55 user nova-compute[73520]:         <nova:project uuid="57dd566104a645fd8abda43da8d9b980">tempest-ServerActionsTestOtherA-294187005</nova:project>
Aug 16 12:18:55 user nova-compute[73520]:       </nova:owner>
Aug 16 12:18:55 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:18:55 user nova-compute[73520]:       <nova:ports>
Aug 16 12:18:55 user nova-compute[73520]:         <nova:port uuid="27a8f0eb-6244-4a6c-81e7-977795d5ea41">
Aug 16 12:18:55 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 12:18:55 user nova-compute[73520]:         </nova:port>
Aug 16 12:18:55 user nova-compute[73520]:       </nova:ports>
Aug 16 12:18:55 user nova-compute[73520]:     </nova:instance>
Aug 16 12:18:55 user nova-compute[73520]:   </metadata>
Aug 16 12:18:55 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:18:55 user nova-compute[73520]:     <system>
Aug 16 12:18:55 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:18:55 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:18:55 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:18:55 user nova-compute[73520]:       <entry name="serial">5bc17e5d-3ae1-474d-bd49-71c60f3e46be</entry>
Aug 16 12:18:55 user nova-compute[73520]:       <entry name="uuid">5bc17e5d-3ae1-474d-bd49-71c60f3e46be</entry>
Aug 16 12:18:55 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:18:55 user nova-compute[73520]:     </system>
Aug 16 12:18:55 user nova-compute[73520]:   </sysinfo>
Aug 16 12:18:55 user nova-compute[73520]:   <os>
Aug 16 12:18:55 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:18:55 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:18:55 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:18:55 user nova-compute[73520]:   </os>
Aug 16 12:18:55 user nova-compute[73520]:   <features>
Aug 16 12:18:55 user nova-compute[73520]:     <acpi/>
Aug 16 12:18:55 user nova-compute[73520]:     <apic/>
Aug 16 12:18:55 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:18:55 user nova-compute[73520]:   </features>
Aug 16 12:18:55 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:18:55 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:18:55 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:18:55 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:18:55 user nova-compute[73520]:   </clock>
Aug 16 12:18:55 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:18:55 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:18:55 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:18:55 user nova-compute[73520]:   </cpu>
Aug 16 12:18:55 user nova-compute[73520]:   <devices>
Aug 16 12:18:55 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:18:55 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:18:55 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk"/>
Aug 16 12:18:55 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:18:55 user nova-compute[73520]:     </disk>
Aug 16 12:18:55 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:18:55 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:18:55 user nova-compute[73520]:       <source dev="/dev/sdc"/>
Aug 16 12:18:55 user nova-compute[73520]:       <target dev="vdb" bus="virtio"/>
Aug 16 12:18:55 user nova-compute[73520]:       <serial>41f191e0-c282-4ab3-ba32-c95c68d30992</serial>
Aug 16 12:18:55 user nova-compute[73520]:     </disk>
Aug 16 12:18:55 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:18:55 user nova-compute[73520]:       <mac address="fa:16:3e:38:2a:c6"/>
Aug 16 12:18:55 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:18:55 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:18:55 user nova-compute[73520]:       <target dev="tap27a8f0eb-62"/>
Aug 16 12:18:55 user nova-compute[73520]:     </interface>
Aug 16 12:18:55 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:18:55 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/console.log" append="off"/>
Aug 16 12:18:55 user nova-compute[73520]:     </serial>
Aug 16 12:18:55 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:18:55 user nova-compute[73520]:     <video>
Aug 16 12:18:55 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:18:55 user nova-compute[73520]:     </video>
Aug 16 12:18:55 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:18:55 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:18:55 user nova-compute[73520]:     </rng>
Aug 16 12:18:55 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:18:55 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:18:55 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:18:55 user nova-compute[73520]:     </memballoon>
Aug 16 12:18:55 user nova-compute[73520]:   </devices>
Aug 16 12:18:55 user nova-compute[73520]: </domain>
Aug 16 12:18:55 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1602865874',display_name='tempest-ServerActionsTestOtherA-server-326484734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1602865874',id=15,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWDmy7Y42O8TTQkPPhvFapOqey2yzr7+HunIIo/9lzfe8rKUqepoW4Do3+MfNrt5xHtu6/gJraSlGY+a2w8Nv7CvDCfHvcSHnTbLC47JDVntO2l274nBETm3y7rR4CR0A==',key_name='tempest-keypair-305970178',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:16:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-lgydxk2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:18:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=5bc17e5d-3ae1-474d-bd49-71c60f3e46be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG os_vif [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27a8f0eb-62, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27a8f0eb-62, col_values=(('external_ids', {'iface-id': '27a8f0eb-6244-4a6c-81e7-977795d5ea41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:2a:c6', 'vm-uuid': '5bc17e5d-3ae1-474d-bd49-71c60f3e46be'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:55 user nova-compute[73520]: INFO os_vif [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62')
Aug 16 12:18:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:18:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No VIF found with MAC fa:16:3e:38:2a:c6, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:18:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:18:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-69667b03-77f2-4fd4-a9ad-b45e451561e5 req-9fd49bab-ce26-424e-9fa8-98755458cd2a service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received event network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:18:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-69667b03-77f2-4fd4-a9ad-b45e451561e5 req-9fd49bab-ce26-424e-9fa8-98755458cd2a service nova] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:18:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-69667b03-77f2-4fd4-a9ad-b45e451561e5 req-9fd49bab-ce26-424e-9fa8-98755458cd2a service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:18:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-69667b03-77f2-4fd4-a9ad-b45e451561e5 req-9fd49bab-ce26-424e-9fa8-98755458cd2a service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:18:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-69667b03-77f2-4fd4-a9ad-b45e451561e5 req-9fd49bab-ce26-424e-9fa8-98755458cd2a service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] No waiting events found dispatching network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:18:58 user nova-compute[73520]: WARNING nova.compute.manager [req-69667b03-77f2-4fd4-a9ad-b45e451561e5 req-9fd49bab-ce26-424e-9fa8-98755458cd2a service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received unexpected event network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 12:18:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-8d14e610-fcb2-4bb4-aed9-9b47570a90ff req-1de59a3a-df43-4548-a92d-7b0eca3bf62b service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received event network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d14e610-fcb2-4bb4-aed9-9b47570a90ff req-1de59a3a-df43-4548-a92d-7b0eca3bf62b service nova] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d14e610-fcb2-4bb4-aed9-9b47570a90ff req-1de59a3a-df43-4548-a92d-7b0eca3bf62b service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8d14e610-fcb2-4bb4-aed9-9b47570a90ff req-1de59a3a-df43-4548-a92d-7b0eca3bf62b service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-8d14e610-fcb2-4bb4-aed9-9b47570a90ff req-1de59a3a-df43-4548-a92d-7b0eca3bf62b service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] No waiting events found dispatching network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:00 user nova-compute[73520]: WARNING nova.compute.manager [req-8d14e610-fcb2-4bb4-aed9-9b47570a90ff req-1de59a3a-df43-4548-a92d-7b0eca3bf62b service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received unexpected event network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 12:19:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188340.8062139, 5bc17e5d-3ae1-474d-bd49-71c60f3e46be => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:00 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] VM Resumed (Lifecycle Event)
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:19:00 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Instance spawned successfully.
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:00 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188340.8158913, 5bc17e5d-3ae1-474d-bd49-71c60f3e46be => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:00 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] VM Started (Lifecycle Event)
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:19:00 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 12:19:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:01 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73520) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 12:19:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d580ef23-05aa-47d7-b628-fcec339a2cdb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.086s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "df229b3d-196d-4764-b896-19c882d27d17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "df229b3d-196d-4764-b896-19c882d27d17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:19:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:19:05 user nova-compute[73520]: INFO nova.compute.claims [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Claim successful on node user
Aug 16 12:19:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:06 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:19:06 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:19:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:19:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:19:06 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:19:06 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:19:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:19:06 user nova-compute[73520]: INFO nova.virt.block_device [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Booting with volume snapshot 4ac2fe64-8e81-476e-8220-c583e129c813 at /dev/vda
Aug 16 12:19:06 user nova-compute[73520]: DEBUG nova.policy [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17ed1823b0de433ab523470e235fdd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a693cd27934644be8e64731417c66783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:19:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-092d4f17-336e-4d2b-8dcc-5de1f4363e95 req-c8d4ae1f-c8db-48ed-bffb-ed04d76d3025 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-changed-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-092d4f17-336e-4d2b-8dcc-5de1f4363e95 req-c8d4ae1f-c8db-48ed-bffb-ed04d76d3025 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Refreshing instance network info cache due to event network-changed-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:19:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-092d4f17-336e-4d2b-8dcc-5de1f4363e95 req-c8d4ae1f-c8db-48ed-bffb-ed04d76d3025 service nova] Acquiring lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-092d4f17-336e-4d2b-8dcc-5de1f4363e95 req-c8d4ae1f-c8db-48ed-bffb-ed04d76d3025 service nova] Acquired lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:08 user nova-compute[73520]: DEBUG nova.network.neutron [req-092d4f17-336e-4d2b-8dcc-5de1f4363e95 req-c8d4ae1f-c8db-48ed-bffb-ed04d76d3025 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Refreshing network info cache for port f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:19:08 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Successfully created port: a1ccfcb5-97a3-4526-aabd-ade6796398f3 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:19:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:08 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Successfully updated port: a1ccfcb5-97a3-4526-aabd-ade6796398f3 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:19:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "refresh_cache-df229b3d-196d-4764-b896-19c882d27d17" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquired lock "refresh_cache-df229b3d-196d-4764-b896-19c882d27d17" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:08 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:19:09 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:19:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-092d4f17-336e-4d2b-8dcc-5de1f4363e95 req-c8d4ae1f-c8db-48ed-bffb-ed04d76d3025 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updated VIF entry in instance network info cache for port f9fc71dc-3ee9-497a-a60e-e39046c2d9f3. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:19:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-092d4f17-336e-4d2b-8dcc-5de1f4363e95 req-c8d4ae1f-c8db-48ed-bffb-ed04d76d3025 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updating instance_info_cache with network_info: [{"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-092d4f17-336e-4d2b-8dcc-5de1f4363e95 req-c8d4ae1f-c8db-48ed-bffb-ed04d76d3025 service nova] Releasing lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:09 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Updating instance_info_cache with network_info: [{"id": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "address": "fa:16:3e:64:7c:58", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ccfcb5-97", "ovs_interfaceid": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Releasing lock "refresh_cache-df229b3d-196d-4764-b896-19c882d27d17" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Instance network_info: |[{"id": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "address": "fa:16:3e:64:7c:58", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ccfcb5-97", "ovs_interfaceid": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:19:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-a9cb2d02-13d5-4a31-94fa-401fb0ff5f1b req-85228730-08dc-4161-abe4-ed11ecfc5ab7 service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Received event network-changed-a1ccfcb5-97a3-4526-aabd-ade6796398f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-a9cb2d02-13d5-4a31-94fa-401fb0ff5f1b req-85228730-08dc-4161-abe4-ed11ecfc5ab7 service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Refreshing instance network info cache due to event network-changed-a1ccfcb5-97a3-4526-aabd-ade6796398f3. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:19:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a9cb2d02-13d5-4a31-94fa-401fb0ff5f1b req-85228730-08dc-4161-abe4-ed11ecfc5ab7 service nova] Acquiring lock "refresh_cache-df229b3d-196d-4764-b896-19c882d27d17" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a9cb2d02-13d5-4a31-94fa-401fb0ff5f1b req-85228730-08dc-4161-abe4-ed11ecfc5ab7 service nova] Acquired lock "refresh_cache-df229b3d-196d-4764-b896-19c882d27d17" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:10 user nova-compute[73520]: DEBUG nova.network.neutron [req-a9cb2d02-13d5-4a31-94fa-401fb0ff5f1b req-85228730-08dc-4161-abe4-ed11ecfc5ab7 service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Refreshing network info cache for port a1ccfcb5-97a3-4526-aabd-ade6796398f3 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:19:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-a9cb2d02-13d5-4a31-94fa-401fb0ff5f1b req-85228730-08dc-4161-abe4-ed11ecfc5ab7 service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Updated VIF entry in instance network info cache for port a1ccfcb5-97a3-4526-aabd-ade6796398f3. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:19:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-a9cb2d02-13d5-4a31-94fa-401fb0ff5f1b req-85228730-08dc-4161-abe4-ed11ecfc5ab7 service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Updating instance_info_cache with network_info: [{"id": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "address": "fa:16:3e:64:7c:58", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ccfcb5-97", "ovs_interfaceid": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a9cb2d02-13d5-4a31-94fa-401fb0ff5f1b req-85228730-08dc-4161-abe4-ed11ecfc5ab7 service nova] Releasing lock "refresh_cache-df229b3d-196d-4764-b896-19c882d27d17" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG os_brick.utils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7681a5dc-8e59-4529-ab13-3f6a4c6749da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11a3b91-eaef-48c9-86e7-127b4d9f9442]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66ff3e2-01c4-4d30-8f41-b86dd933ca33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[83793ea6-d249-4b34-87b4-8e9dc51ff4d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:19:12 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:19:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee72a16-275c-4320-82da-0c6d56debe2c]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG os_brick.utils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:19:12 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Updating existing volume attachment record: a9f21596-04ad-4c84-b1e7-59bab062912a {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:19:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "91e479f7-5fc0-46d2-9c02-52175084fbf6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:19:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:19:13 user nova-compute[73520]: INFO nova.compute.claims [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Claim successful on node user
Aug 16 12:19:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:13 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:19:13 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:19:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG nova.network.neutron [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:19:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:19:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG nova.policy [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a3c953350514bab80c857246568c427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f1f97356574bba85e0596dd1b6ed1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:19:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Creating image(s)
Aug 16 12:19:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "/opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "/opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "/opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:14 user nova-compute[73520]: INFO nova.compute.manager [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Detaching volume 4154c7bd-d878-4e40-a992-01e251781ba0
Aug 16 12:19:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.316s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:14 user nova-compute[73520]: INFO nova.virt.block_device [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Attempting to driver detach volume 4154c7bd-d878-4e40-a992-01e251781ba0 from mountpoint /dev/vdb
Aug 16 12:19:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Attempting to detach device vdb from instance 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:19:14 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:19:14 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:19:14 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:19:14 user nova-compute[73520]:   <serial>4154c7bd-d878-4e40-a992-01e251781ba0</serial>
Aug 16 12:19:14 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:19:14 user nova-compute[73520]: </disk>
Aug 16 12:19:14 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:19:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Successfully detached device vdb from instance 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a from the persistent domain config.
Aug 16 12:19:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:19:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:19:14 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:19:14 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:19:14 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:19:14 user nova-compute[73520]:   <serial>4154c7bd-d878-4e40-a992-01e251781ba0</serial>
Aug 16 12:19:14 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:19:14 user nova-compute[73520]: </disk>
Aug 16 12:19:14 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.242s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk 1073741824" returned: 0 in 0.065s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.285s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG nova.network.neutron [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Successfully created port: 2905850b-ae11-4b8f-9f36-8843981fc748 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188355.5267904, 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:19:15 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Successfully detached device vdb from instance 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a from the live domain config.
Aug 16 12:19:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDTKFyiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:19:15 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[77574f2f-dc9d-47d8-80e9-18a71e59970a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a451ecc-606a-4d1a-a7aa-8661de50e003]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:19:15 user nova-compute[73520]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:19:15 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 (non-flash)
Aug 16 12:19:15 user nova-compute[73520]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:19:15 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c6d3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Cannot resize image /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG nova.objects.instance [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lazy-loading 'migration_context' on Instance uuid 91e479f7-5fc0-46d2-9c02-52175084fbf6 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[13017306-da4c-494c-97c3-a48a116f27f3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Ensure instance console log exists: /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aa430b-47f1-4657-8c8d-96c19d22af80]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfefb6e-47bf-4685-88e4-17a9c29e8dd0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc8d509-1d90-48d8-9187-22bf095d083b]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1fd1a5-701a-415e-88c5-3a7c09d33450]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e90f68-c66a-4483-8e2c-493f0f062d00]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0, portal: 172.16.0.220,3260]
Aug 16 12:19:15 user nova-compute[73520]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0, portal: 172.16.0.220,3260] successful.
Aug 16 12:19:15 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4154c7bd-d878-4e40-a992-01e251781ba0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4510c103-c6c9-459b-b300-a5e267b7e32f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] <== disconnect_volume: return (348ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:19:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:19:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Successfully updated port: 2905850b-ae11-4b8f-9f36-8843981fc748 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:19:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "refresh_cache-91e479f7-5fc0-46d2-9c02-52175084fbf6" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquired lock "refresh_cache-91e479f7-5fc0-46d2-9c02-52175084fbf6" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:19:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-62f5fab4-9c62-422c-afe9-e98421ae9904 req-3137990d-38ca-4cb6-8152-2a465b6d239d service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Received event network-changed-2905850b-ae11-4b8f-9f36-8843981fc748 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-62f5fab4-9c62-422c-afe9-e98421ae9904 req-3137990d-38ca-4cb6-8152-2a465b6d239d service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Refreshing instance network info cache due to event network-changed-2905850b-ae11-4b8f-9f36-8843981fc748. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:19:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62f5fab4-9c62-422c-afe9-e98421ae9904 req-3137990d-38ca-4cb6-8152-2a465b6d239d service nova] Acquiring lock "refresh_cache-91e479f7-5fc0-46d2-9c02-52175084fbf6" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.objects.instance [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lazy-loading 'flavor' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-372a860b-f8fb-40d1-9cd3-308ee5b06cc8 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.381s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Updating instance_info_cache with network_info: [{"id": "2905850b-ae11-4b8f-9f36-8843981fc748", "address": "fa:16:3e:e5:45:a0", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2905850b-ae", "ovs_interfaceid": "2905850b-ae11-4b8f-9f36-8843981fc748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Releasing lock "refresh_cache-91e479f7-5fc0-46d2-9c02-52175084fbf6" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Instance network_info: |[{"id": "2905850b-ae11-4b8f-9f36-8843981fc748", "address": "fa:16:3e:e5:45:a0", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2905850b-ae", "ovs_interfaceid": "2905850b-ae11-4b8f-9f36-8843981fc748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62f5fab4-9c62-422c-afe9-e98421ae9904 req-3137990d-38ca-4cb6-8152-2a465b6d239d service nova] Acquired lock "refresh_cache-91e479f7-5fc0-46d2-9c02-52175084fbf6" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.network.neutron [req-62f5fab4-9c62-422c-afe9-e98421ae9904 req-3137990d-38ca-4cb6-8152-2a465b6d239d service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Refreshing network info cache for port 2905850b-ae11-4b8f-9f36-8843981fc748 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Start _get_guest_xml network_info=[{"id": "2905850b-ae11-4b8f-9f36-8843981fc748", "address": "fa:16:3e:e5:45:a0", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2905850b-ae", "ovs_interfaceid": "2905850b-ae11-4b8f-9f36-8843981fc748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:19:17 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:19:17 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1850059560',display_name='tempest-ServersNegativeTestJSON-server-1850059560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1850059560',id=19,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95f1f97356574bba85e0596dd1b6ed1f',ramdisk_id='',reservation_id='r-k7gtr1zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1387585068',owner_user_name='tempest-ServersNegativeTestJSON-1387585068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:19:14Z,user_data=None,user_id='2a3c953350514bab80c857246568c427',uuid=91e479f7-5fc0-46d2-9c02-52175084fbf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2905850b-ae11-4b8f-9f36-8843981fc748", "address": "fa:16:3e:e5:45:a0", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2905850b-ae", "ovs_interfaceid": "2905850b-ae11-4b8f-9f36-8843981fc748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Converting VIF {"id": "2905850b-ae11-4b8f-9f36-8843981fc748", "address": "fa:16:3e:e5:45:a0", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2905850b-ae", "ovs_interfaceid": "2905850b-ae11-4b8f-9f36-8843981fc748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:45:a0,bridge_name='br-int',has_traffic_filtering=True,id=2905850b-ae11-4b8f-9f36-8843981fc748,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2905850b-ae') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.objects.instance [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lazy-loading 'pci_devices' on Instance uuid 91e479f7-5fc0-46d2-9c02-52175084fbf6 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:19:17 user nova-compute[73520]:   <uuid>91e479f7-5fc0-46d2-9c02-52175084fbf6</uuid>
Aug 16 12:19:17 user nova-compute[73520]:   <name>instance-00000013</name>
Aug 16 12:19:17 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:19:17 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:19:17 user nova-compute[73520]:   <metadata>
Aug 16 12:19:17 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:19:17 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:19:17 user nova-compute[73520]:       <nova:name>tempest-ServersNegativeTestJSON-server-1850059560</nova:name>
Aug 16 12:19:17 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:19:17</nova:creationTime>
Aug 16 12:19:17 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:19:17 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:19:17 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:19:17 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:19:17 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:19:17 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:19:17 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:19:17 user nova-compute[73520]:       <nova:owner>
Aug 16 12:19:17 user nova-compute[73520]:         <nova:user uuid="2a3c953350514bab80c857246568c427">tempest-ServersNegativeTestJSON-1387585068-project-member</nova:user>
Aug 16 12:19:17 user nova-compute[73520]:         <nova:project uuid="95f1f97356574bba85e0596dd1b6ed1f">tempest-ServersNegativeTestJSON-1387585068</nova:project>
Aug 16 12:19:17 user nova-compute[73520]:       </nova:owner>
Aug 16 12:19:17 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:19:17 user nova-compute[73520]:       <nova:ports>
Aug 16 12:19:17 user nova-compute[73520]:         <nova:port uuid="2905850b-ae11-4b8f-9f36-8843981fc748">
Aug 16 12:19:17 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 12:19:17 user nova-compute[73520]:         </nova:port>
Aug 16 12:19:17 user nova-compute[73520]:       </nova:ports>
Aug 16 12:19:17 user nova-compute[73520]:     </nova:instance>
Aug 16 12:19:17 user nova-compute[73520]:   </metadata>
Aug 16 12:19:17 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:19:17 user nova-compute[73520]:     <system>
Aug 16 12:19:17 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:19:17 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:19:17 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:19:17 user nova-compute[73520]:       <entry name="serial">91e479f7-5fc0-46d2-9c02-52175084fbf6</entry>
Aug 16 12:19:17 user nova-compute[73520]:       <entry name="uuid">91e479f7-5fc0-46d2-9c02-52175084fbf6</entry>
Aug 16 12:19:17 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:19:17 user nova-compute[73520]:     </system>
Aug 16 12:19:17 user nova-compute[73520]:   </sysinfo>
Aug 16 12:19:17 user nova-compute[73520]:   <os>
Aug 16 12:19:17 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:19:17 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:19:17 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:19:17 user nova-compute[73520]:   </os>
Aug 16 12:19:17 user nova-compute[73520]:   <features>
Aug 16 12:19:17 user nova-compute[73520]:     <acpi/>
Aug 16 12:19:17 user nova-compute[73520]:     <apic/>
Aug 16 12:19:17 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:19:17 user nova-compute[73520]:   </features>
Aug 16 12:19:17 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:19:17 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:19:17 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:19:17 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:19:17 user nova-compute[73520]:   </clock>
Aug 16 12:19:17 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:19:17 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:19:17 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:19:17 user nova-compute[73520]:   </cpu>
Aug 16 12:19:17 user nova-compute[73520]:   <devices>
Aug 16 12:19:17 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:19:17 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:19:17 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk"/>
Aug 16 12:19:17 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:19:17 user nova-compute[73520]:     </disk>
Aug 16 12:19:17 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:19:17 user nova-compute[73520]:       <mac address="fa:16:3e:e5:45:a0"/>
Aug 16 12:19:17 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:19:17 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:19:17 user nova-compute[73520]:       <target dev="tap2905850b-ae"/>
Aug 16 12:19:17 user nova-compute[73520]:     </interface>
Aug 16 12:19:17 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:19:17 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/console.log" append="off"/>
Aug 16 12:19:17 user nova-compute[73520]:     </serial>
Aug 16 12:19:17 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:19:17 user nova-compute[73520]:     <video>
Aug 16 12:19:17 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:19:17 user nova-compute[73520]:     </video>
Aug 16 12:19:17 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:19:17 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:19:17 user nova-compute[73520]:     </rng>
Aug 16 12:19:17 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:19:17 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:19:17 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:19:17 user nova-compute[73520]:     </memballoon>
Aug 16 12:19:17 user nova-compute[73520]:   </devices>
Aug 16 12:19:17 user nova-compute[73520]: </domain>
Aug 16 12:19:17 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1850059560',display_name='tempest-ServersNegativeTestJSON-server-1850059560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1850059560',id=19,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95f1f97356574bba85e0596dd1b6ed1f',ramdisk_id='',reservation_id='r-k7gtr1zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1387585068',owner_user_name='tempest-ServersNegativeTestJSON-1387585068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:19:14Z,user_data=None,user_id='2a3c953350514bab80c857246568c427',uuid=91e479f7-5fc0-46d2-9c02-52175084fbf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2905850b-ae11-4b8f-9f36-8843981fc748", "address": "fa:16:3e:e5:45:a0", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2905850b-ae", "ovs_interfaceid": "2905850b-ae11-4b8f-9f36-8843981fc748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Converting VIF {"id": "2905850b-ae11-4b8f-9f36-8843981fc748", "address": "fa:16:3e:e5:45:a0", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2905850b-ae", "ovs_interfaceid": "2905850b-ae11-4b8f-9f36-8843981fc748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:45:a0,bridge_name='br-int',has_traffic_filtering=True,id=2905850b-ae11-4b8f-9f36-8843981fc748,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2905850b-ae') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG os_vif [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:45:a0,bridge_name='br-int',has_traffic_filtering=True,id=2905850b-ae11-4b8f-9f36-8843981fc748,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2905850b-ae') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2905850b-ae, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2905850b-ae, col_values=(('external_ids', {'iface-id': '2905850b-ae11-4b8f-9f36-8843981fc748', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:45:a0', 'vm-uuid': '91e479f7-5fc0-46d2-9c02-52175084fbf6'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:17 user nova-compute[73520]: INFO os_vif [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:45:a0,bridge_name='br-int',has_traffic_filtering=True,id=2905850b-ae11-4b8f-9f36-8843981fc748,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2905850b-ae')
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] No VIF found with MAC fa:16:3e:e5:45:a0, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.network.neutron [req-62f5fab4-9c62-422c-afe9-e98421ae9904 req-3137990d-38ca-4cb6-8152-2a465b6d239d service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Updated VIF entry in instance network info cache for port 2905850b-ae11-4b8f-9f36-8843981fc748. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG nova.network.neutron [req-62f5fab4-9c62-422c-afe9-e98421ae9904 req-3137990d-38ca-4cb6-8152-2a465b6d239d service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Updating instance_info_cache with network_info: [{"id": "2905850b-ae11-4b8f-9f36-8843981fc748", "address": "fa:16:3e:e5:45:a0", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2905850b-ae", "ovs_interfaceid": "2905850b-ae11-4b8f-9f36-8843981fc748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-62f5fab4-9c62-422c-afe9-e98421ae9904 req-3137990d-38ca-4cb6-8152-2a465b6d239d service nova] Releasing lock "refresh_cache-91e479f7-5fc0-46d2-9c02-52175084fbf6" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-144e0adb-a377-4904-80d3-da05957af914 req-181da97b-45e2-4cb4-a3ce-f136935b1ccc service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Received event network-vif-plugged-2905850b-ae11-4b8f-9f36-8843981fc748 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-144e0adb-a377-4904-80d3-da05957af914 req-181da97b-45e2-4cb4-a3ce-f136935b1ccc service nova] Acquiring lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-144e0adb-a377-4904-80d3-da05957af914 req-181da97b-45e2-4cb4-a3ce-f136935b1ccc service nova] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-144e0adb-a377-4904-80d3-da05957af914 req-181da97b-45e2-4cb4-a3ce-f136935b1ccc service nova] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-144e0adb-a377-4904-80d3-da05957af914 req-181da97b-45e2-4cb4-a3ce-f136935b1ccc service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] No waiting events found dispatching network-vif-plugged-2905850b-ae11-4b8f-9f36-8843981fc748 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:19 user nova-compute[73520]: WARNING nova.compute.manager [req-144e0adb-a377-4904-80d3-da05957af914 req-181da97b-45e2-4cb4-a3ce-f136935b1ccc service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Received unexpected event network-vif-plugged-2905850b-ae11-4b8f-9f36-8843981fc748 for instance with vm_state building and task_state spawning.
Aug 16 12:19:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:20 user nova-compute[73520]: INFO nova.compute.manager [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Shelving
Aug 16 12:19:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-c2d62ebe-fa67-4d5f-a3c6-9f69cca6af11 req-13952c27-60cc-4424-bfc9-d391553e625d service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Received event network-vif-plugged-2905850b-ae11-4b8f-9f36-8843981fc748 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c2d62ebe-fa67-4d5f-a3c6-9f69cca6af11 req-13952c27-60cc-4424-bfc9-d391553e625d service nova] Acquiring lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c2d62ebe-fa67-4d5f-a3c6-9f69cca6af11 req-13952c27-60cc-4424-bfc9-d391553e625d service nova] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c2d62ebe-fa67-4d5f-a3c6-9f69cca6af11 req-13952c27-60cc-4424-bfc9-d391553e625d service nova] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-c2d62ebe-fa67-4d5f-a3c6-9f69cca6af11 req-13952c27-60cc-4424-bfc9-d391553e625d service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] No waiting events found dispatching network-vif-plugged-2905850b-ae11-4b8f-9f36-8843981fc748 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:21 user nova-compute[73520]: WARNING nova.compute.manager [req-c2d62ebe-fa67-4d5f-a3c6-9f69cca6af11 req-13952c27-60cc-4424-bfc9-d391553e625d service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Received unexpected event network-vif-plugged-2905850b-ae11-4b8f-9f36-8843981fc748 for instance with vm_state building and task_state spawning.
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188361.2146409, 91e479f7-5fc0-46d2-9c02-52175084fbf6 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:21 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] VM Resumed (Lifecycle Event)
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:19:21 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Instance spawned successfully.
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:21 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188361.2160783, 91e479f7-5fc0-46d2-9c02-52175084fbf6 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:21 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] VM Started (Lifecycle Event)
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:19:21 user nova-compute[73520]: INFO nova.compute.manager [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Took 6.93 seconds to spawn the instance on the hypervisor.
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:21 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:19:21 user nova-compute[73520]: INFO nova.compute.manager [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Took 8.32 seconds to build instance.
Aug 16 12:19:21 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Instance destroyed successfully.
Aug 16 12:19:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5893e96f-7ed9-42d4-8235-9412b3df053a tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.531s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:21 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Beginning cold snapshot process
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-36609f81-e0ef-4acd-a142-20c854b62ea5 req-5baa641f-4c17-4b4d-a1e4-a92a8a9c2ed7 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-vif-unplugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-36609f81-e0ef-4acd-a142-20c854b62ea5 req-5baa641f-4c17-4b4d-a1e4-a92a8a9c2ed7 service nova] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-36609f81-e0ef-4acd-a142-20c854b62ea5 req-5baa641f-4c17-4b4d-a1e4-a92a8a9c2ed7 service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-36609f81-e0ef-4acd-a142-20c854b62ea5 req-5baa641f-4c17-4b4d-a1e4-a92a8a9c2ed7 service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-36609f81-e0ef-4acd-a142-20c854b62ea5 req-5baa641f-4c17-4b4d-a1e4-a92a8a9c2ed7 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] No waiting events found dispatching network-vif-unplugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:21 user nova-compute[73520]: WARNING nova.compute.manager [req-36609f81-e0ef-4acd-a142-20c854b62ea5 req-5baa641f-4c17-4b4d-a1e4-a92a8a9c2ed7 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received unexpected event network-vif-unplugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 16 12:19:21 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:19:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk /opt/stack/data/nova/instances/snapshots/tmpjylk02dq/db0ea9e2411b463489be67605fed0483 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk /opt/stack/data/nova/instances/snapshots/tmpjylk02dq/db0ea9e2411b463489be67605fed0483" returned: 0 in 0.911s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:22 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Snapshot extracted, beginning image upload
Aug 16 12:19:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "4aec6c13-9121-4c61-9844-d28d420fde09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "4aec6c13-9121-4c61-9844-d28d420fde09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:19:23 user nova-compute[73520]: INFO nova.compute.claims [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Claim successful on node user
Aug 16 12:19:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG nova.network.neutron [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:19:23 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:19:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG nova.compute.manager [req-255917ff-ffe2-4297-bfd9-b10547f2bc26 req-80c0e08a-639a-44c2-8cb2-fea7830978af service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-255917ff-ffe2-4297-bfd9-b10547f2bc26 req-80c0e08a-639a-44c2-8cb2-fea7830978af service nova] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-255917ff-ffe2-4297-bfd9-b10547f2bc26 req-80c0e08a-639a-44c2-8cb2-fea7830978af service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-255917ff-ffe2-4297-bfd9-b10547f2bc26 req-80c0e08a-639a-44c2-8cb2-fea7830978af service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG nova.compute.manager [req-255917ff-ffe2-4297-bfd9-b10547f2bc26 req-80c0e08a-639a-44c2-8cb2-fea7830978af service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] No waiting events found dispatching network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:23 user nova-compute[73520]: WARNING nova.compute.manager [req-255917ff-ffe2-4297-bfd9-b10547f2bc26 req-80c0e08a-639a-44c2-8cb2-fea7830978af service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received unexpected event network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 12:19:23 user nova-compute[73520]: DEBUG nova.policy [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '223a4316eda946d38dd77143a4847484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2639b61de64add87f6510f520aa158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:19:23 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Creating image(s)
Aug 16 12:19:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "/opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "/opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "/opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.260s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.221s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk 1073741824" returned: 0 in 0.080s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG nova.network.neutron [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Successfully created port: 37d3de01-eaaf-4b05-b262-2a5359a07310 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.289s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:19:24 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:25 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Cannot resize image /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:19:25 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lazy-loading 'migration_context' on Instance uuid 4aec6c13-9121-4c61-9844-d28d420fde09 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:19:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Ensure instance console log exists: /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:19:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Successfully updated port: 37d3de01-eaaf-4b05-b262-2a5359a07310 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:19:26 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Snapshot image upload complete
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "refresh_cache-4aec6c13-9121-4c61-9844-d28d420fde09" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquired lock "refresh_cache-4aec6c13-9121-4c61-9844-d28d420fde09" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.compute.manager [req-c1e0e7da-2257-4a38-90f4-f53f106eda62 req-f2f1d58d-68c0-4041-8879-04c2a3952b0e service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Received event network-changed-37d3de01-eaaf-4b05-b262-2a5359a07310 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.compute.manager [req-c1e0e7da-2257-4a38-90f4-f53f106eda62 req-f2f1d58d-68c0-4041-8879-04c2a3952b0e service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Refreshing instance network info cache due to event network-changed-37d3de01-eaaf-4b05-b262-2a5359a07310. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c1e0e7da-2257-4a38-90f4-f53f106eda62 req-f2f1d58d-68c0-4041-8879-04c2a3952b0e service nova] Acquiring lock "refresh_cache-4aec6c13-9121-4c61-9844-d28d420fde09" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:19:26 user nova-compute[73520]: INFO nova.compute.manager [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Shelve offloading
Aug 16 12:19:26 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Instance destroyed successfully.
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquired lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Updating instance_info_cache with network_info: [{"id": "37d3de01-eaaf-4b05-b262-2a5359a07310", "address": "fa:16:3e:7a:e6:f8", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d3de01-ea", "ovs_interfaceid": "37d3de01-eaaf-4b05-b262-2a5359a07310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Releasing lock "refresh_cache-4aec6c13-9121-4c61-9844-d28d420fde09" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Instance network_info: |[{"id": "37d3de01-eaaf-4b05-b262-2a5359a07310", "address": "fa:16:3e:7a:e6:f8", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d3de01-ea", "ovs_interfaceid": "37d3de01-eaaf-4b05-b262-2a5359a07310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c1e0e7da-2257-4a38-90f4-f53f106eda62 req-f2f1d58d-68c0-4041-8879-04c2a3952b0e service nova] Acquired lock "refresh_cache-4aec6c13-9121-4c61-9844-d28d420fde09" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.network.neutron [req-c1e0e7da-2257-4a38-90f4-f53f106eda62 req-f2f1d58d-68c0-4041-8879-04c2a3952b0e service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Refreshing network info cache for port 37d3de01-eaaf-4b05-b262-2a5359a07310 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Start _get_guest_xml network_info=[{"id": "37d3de01-eaaf-4b05-b262-2a5359a07310", "address": "fa:16:3e:7a:e6:f8", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d3de01-ea", "ovs_interfaceid": "37d3de01-eaaf-4b05-b262-2a5359a07310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:19:26 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:19:26 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-125156199',display_name='tempest-VolumesActionsTest-instance-125156199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-125156199',id=20,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa2639b61de64add87f6510f520aa158',ramdisk_id='',reservation_id='r-0bsmn55c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-623859009',owner_user_name='tempest-VolumesActionsTest-623859009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:19:24Z,user_data=None,user_id='223a4316eda946d38dd77143a4847484',uuid=4aec6c13-9121-4c61-9844-d28d420fde09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37d3de01-eaaf-4b05-b262-2a5359a07310", "address": "fa:16:3e:7a:e6:f8", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d3de01-ea", "ovs_interfaceid": "37d3de01-eaaf-4b05-b262-2a5359a07310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Converting VIF {"id": "37d3de01-eaaf-4b05-b262-2a5359a07310", "address": "fa:16:3e:7a:e6:f8", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d3de01-ea", "ovs_interfaceid": "37d3de01-eaaf-4b05-b262-2a5359a07310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e6:f8,bridge_name='br-int',has_traffic_filtering=True,id=37d3de01-eaaf-4b05-b262-2a5359a07310,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d3de01-ea') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lazy-loading 'pci_devices' on Instance uuid 4aec6c13-9121-4c61-9844-d28d420fde09 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:19:26 user nova-compute[73520]:   <uuid>4aec6c13-9121-4c61-9844-d28d420fde09</uuid>
Aug 16 12:19:26 user nova-compute[73520]:   <name>instance-00000014</name>
Aug 16 12:19:26 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:19:26 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:19:26 user nova-compute[73520]:   <metadata>
Aug 16 12:19:26 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:19:26 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:19:26 user nova-compute[73520]:       <nova:name>tempest-VolumesActionsTest-instance-125156199</nova:name>
Aug 16 12:19:26 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:19:26</nova:creationTime>
Aug 16 12:19:26 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:19:26 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:19:26 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:19:26 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:19:26 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:19:26 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:19:26 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:19:26 user nova-compute[73520]:       <nova:owner>
Aug 16 12:19:26 user nova-compute[73520]:         <nova:user uuid="223a4316eda946d38dd77143a4847484">tempest-VolumesActionsTest-623859009-project-member</nova:user>
Aug 16 12:19:26 user nova-compute[73520]:         <nova:project uuid="fa2639b61de64add87f6510f520aa158">tempest-VolumesActionsTest-623859009</nova:project>
Aug 16 12:19:26 user nova-compute[73520]:       </nova:owner>
Aug 16 12:19:26 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:19:26 user nova-compute[73520]:       <nova:ports>
Aug 16 12:19:26 user nova-compute[73520]:         <nova:port uuid="37d3de01-eaaf-4b05-b262-2a5359a07310">
Aug 16 12:19:26 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 12:19:26 user nova-compute[73520]:         </nova:port>
Aug 16 12:19:26 user nova-compute[73520]:       </nova:ports>
Aug 16 12:19:26 user nova-compute[73520]:     </nova:instance>
Aug 16 12:19:26 user nova-compute[73520]:   </metadata>
Aug 16 12:19:26 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:19:26 user nova-compute[73520]:     <system>
Aug 16 12:19:26 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:19:26 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:19:26 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:19:26 user nova-compute[73520]:       <entry name="serial">4aec6c13-9121-4c61-9844-d28d420fde09</entry>
Aug 16 12:19:26 user nova-compute[73520]:       <entry name="uuid">4aec6c13-9121-4c61-9844-d28d420fde09</entry>
Aug 16 12:19:26 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:19:26 user nova-compute[73520]:     </system>
Aug 16 12:19:26 user nova-compute[73520]:   </sysinfo>
Aug 16 12:19:26 user nova-compute[73520]:   <os>
Aug 16 12:19:26 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:19:26 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:19:26 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:19:26 user nova-compute[73520]:   </os>
Aug 16 12:19:26 user nova-compute[73520]:   <features>
Aug 16 12:19:26 user nova-compute[73520]:     <acpi/>
Aug 16 12:19:26 user nova-compute[73520]:     <apic/>
Aug 16 12:19:26 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:19:26 user nova-compute[73520]:   </features>
Aug 16 12:19:26 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:19:26 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:19:26 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:19:26 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:19:26 user nova-compute[73520]:   </clock>
Aug 16 12:19:26 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:19:26 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:19:26 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:19:26 user nova-compute[73520]:   </cpu>
Aug 16 12:19:26 user nova-compute[73520]:   <devices>
Aug 16 12:19:26 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:19:26 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:19:26 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk"/>
Aug 16 12:19:26 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:19:26 user nova-compute[73520]:     </disk>
Aug 16 12:19:26 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:19:26 user nova-compute[73520]:       <mac address="fa:16:3e:7a:e6:f8"/>
Aug 16 12:19:26 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:19:26 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:19:26 user nova-compute[73520]:       <target dev="tap37d3de01-ea"/>
Aug 16 12:19:26 user nova-compute[73520]:     </interface>
Aug 16 12:19:26 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:19:26 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/console.log" append="off"/>
Aug 16 12:19:26 user nova-compute[73520]:     </serial>
Aug 16 12:19:26 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:19:26 user nova-compute[73520]:     <video>
Aug 16 12:19:26 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:19:26 user nova-compute[73520]:     </video>
Aug 16 12:19:26 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:19:26 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:19:26 user nova-compute[73520]:     </rng>
Aug 16 12:19:26 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:19:26 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:19:26 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:19:26 user nova-compute[73520]:     </memballoon>
Aug 16 12:19:26 user nova-compute[73520]:   </devices>
Aug 16 12:19:26 user nova-compute[73520]: </domain>
Aug 16 12:19:26 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-125156199',display_name='tempest-VolumesActionsTest-instance-125156199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-125156199',id=20,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa2639b61de64add87f6510f520aa158',ramdisk_id='',reservation_id='r-0bsmn55c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-623859009',owner_user_name='tempest-VolumesActionsTest-623859009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:19:24Z,user_data=None,user_id='223a4316eda946d38dd77143a4847484',uuid=4aec6c13-9121-4c61-9844-d28d420fde09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37d3de01-eaaf-4b05-b262-2a5359a07310", "address": "fa:16:3e:7a:e6:f8", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d3de01-ea", "ovs_interfaceid": "37d3de01-eaaf-4b05-b262-2a5359a07310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Converting VIF {"id": "37d3de01-eaaf-4b05-b262-2a5359a07310", "address": "fa:16:3e:7a:e6:f8", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d3de01-ea", "ovs_interfaceid": "37d3de01-eaaf-4b05-b262-2a5359a07310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e6:f8,bridge_name='br-int',has_traffic_filtering=True,id=37d3de01-eaaf-4b05-b262-2a5359a07310,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d3de01-ea') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG os_vif [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e6:f8,bridge_name='br-int',has_traffic_filtering=True,id=37d3de01-eaaf-4b05-b262-2a5359a07310,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d3de01-ea') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37d3de01-ea, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37d3de01-ea, col_values=(('external_ids', {'iface-id': '37d3de01-eaaf-4b05-b262-2a5359a07310', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:e6:f8', 'vm-uuid': '4aec6c13-9121-4c61-9844-d28d420fde09'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:26 user nova-compute[73520]: INFO os_vif [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e6:f8,bridge_name='br-int',has_traffic_filtering=True,id=37d3de01-eaaf-4b05-b262-2a5359a07310,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d3de01-ea')
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:19:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] No VIF found with MAC fa:16:3e:7a:e6:f8, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:19:27 user nova-compute[73520]: DEBUG nova.network.neutron [req-c1e0e7da-2257-4a38-90f4-f53f106eda62 req-f2f1d58d-68c0-4041-8879-04c2a3952b0e service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Updated VIF entry in instance network info cache for port 37d3de01-eaaf-4b05-b262-2a5359a07310. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:19:27 user nova-compute[73520]: DEBUG nova.network.neutron [req-c1e0e7da-2257-4a38-90f4-f53f106eda62 req-f2f1d58d-68c0-4041-8879-04c2a3952b0e service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Updating instance_info_cache with network_info: [{"id": "37d3de01-eaaf-4b05-b262-2a5359a07310", "address": "fa:16:3e:7a:e6:f8", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d3de01-ea", "ovs_interfaceid": "37d3de01-eaaf-4b05-b262-2a5359a07310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c1e0e7da-2257-4a38-90f4-f53f106eda62 req-f2f1d58d-68c0-4041-8879-04c2a3952b0e service nova] Releasing lock "refresh_cache-4aec6c13-9121-4c61-9844-d28d420fde09" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:27 user nova-compute[73520]: DEBUG nova.network.neutron [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updating instance_info_cache with network_info: [{"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Releasing lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "1e35c753-7af1-4047-ad06-8b5755207b8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:28 user nova-compute[73520]: INFO nova.compute.manager [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Terminating instance
Aug 16 12:19:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:28 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Instance destroyed successfully.
Aug 16 12:19:28 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'resources' on Instance uuid b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-466509847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-466509847',id=16,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/TnCMohAy4YwXrP4QswrIkP1s67kKydcbM5umHWevLWUF7aB+KeIUkVDD5UpM/sLWKALtErDoubQvYXCvUMMCn8aBxFpkp9OZ9pdoPDYMWBV95Mwsn9Y+0MGtOI3A22Q==',key_name='tempest-keypair-536458928',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ed29e455a840474b8a1407af538883ab',ramdisk_id='',reservation_id='r-ivvsky98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-974908846',owner_user_name='tempest-AttachVolumeShelveTestJSON-974908846-project-member',shelved_at='2023-08-16T12:19:26.215805',shelved_host='user',shelved_image_id='4cec05f3-a47c-4916-bb04-e55d6ba10b5a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7e48ee408e24af083b40b19437cfbac',uuid=b58731e0-399d-4f8d-84b8-af12a46cf87f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converting VIF {"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG os_vif [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9fc71dc-3e, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-3d9b57f8-0955-4468-b988-2ea822ab0fb7 req-5568fec7-4306-4561-83ea-b62069200042 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-changed-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-3d9b57f8-0955-4468-b988-2ea822ab0fb7 req-5568fec7-4306-4561-83ea-b62069200042 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Refreshing instance network info cache due to event network-changed-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3d9b57f8-0955-4468-b988-2ea822ab0fb7 req-5568fec7-4306-4561-83ea-b62069200042 service nova] Acquiring lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3d9b57f8-0955-4468-b988-2ea822ab0fb7 req-5568fec7-4306-4561-83ea-b62069200042 service nova] Acquired lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG nova.network.neutron [req-3d9b57f8-0955-4468-b988-2ea822ab0fb7 req-5568fec7-4306-4561-83ea-b62069200042 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Refreshing network info cache for port f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:19:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:28 user nova-compute[73520]: INFO os_vif [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e')
Aug 16 12:19:28 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Deleting instance files /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f_del
Aug 16 12:19:28 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Deletion of /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f_del complete
Aug 16 12:19:29 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-43cd6385-4370-44f6-9d11-ffd50cfdfd61 req-73577d10-7d31-43da-be9a-37a96b3520ef service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Received event network-vif-unplugged-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-43cd6385-4370-44f6-9d11-ffd50cfdfd61 req-73577d10-7d31-43da-be9a-37a96b3520ef service nova] Acquiring lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-43cd6385-4370-44f6-9d11-ffd50cfdfd61 req-73577d10-7d31-43da-be9a-37a96b3520ef service nova] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-43cd6385-4370-44f6-9d11-ffd50cfdfd61 req-73577d10-7d31-43da-be9a-37a96b3520ef service nova] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-43cd6385-4370-44f6-9d11-ffd50cfdfd61 req-73577d10-7d31-43da-be9a-37a96b3520ef service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] No waiting events found dispatching network-vif-unplugged-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-43cd6385-4370-44f6-9d11-ffd50cfdfd61 req-73577d10-7d31-43da-be9a-37a96b3520ef service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Received event network-vif-unplugged-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:19:29 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Deleted allocations for instance b58731e0-399d-4f8d-84b8-af12a46cf87f
Aug 16 12:19:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'numa_topology' on Instance uuid b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-3e22d94b-21e4-40c3-932d-6e0a036c6f42 req-4a693566-23b1-4712-86d3-e344d93737cd service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Received event network-vif-plugged-37d3de01-eaaf-4b05-b262-2a5359a07310 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3e22d94b-21e4-40c3-932d-6e0a036c6f42 req-4a693566-23b1-4712-86d3-e344d93737cd service nova] Acquiring lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3e22d94b-21e4-40c3-932d-6e0a036c6f42 req-4a693566-23b1-4712-86d3-e344d93737cd service nova] Lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3e22d94b-21e4-40c3-932d-6e0a036c6f42 req-4a693566-23b1-4712-86d3-e344d93737cd service nova] Lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-3e22d94b-21e4-40c3-932d-6e0a036c6f42 req-4a693566-23b1-4712-86d3-e344d93737cd service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] No waiting events found dispatching network-vif-plugged-37d3de01-eaaf-4b05-b262-2a5359a07310 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:29 user nova-compute[73520]: WARNING nova.compute.manager [req-3e22d94b-21e4-40c3-932d-6e0a036c6f42 req-4a693566-23b1-4712-86d3-e344d93737cd service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Received unexpected event network-vif-plugged-37d3de01-eaaf-4b05-b262-2a5359a07310 for instance with vm_state building and task_state spawning.
Aug 16 12:19:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Instance destroyed successfully.
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lazy-loading 'resources' on Instance uuid 1e35c753-7af1-4047-ad06-8b5755207b8e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1449096621',display_name='tempest-VolumesAdminNegativeTest-server-1449096621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1449096621',id=5,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUO6U37UkdUlcpcja9P1QMQWZ/I+GzBbCy8RTsdxB6uyOZ3wSfbapR71JqyCA6v0Kn94AlaeMqTCg9ioX+SLmVcuZxDO1k0S3mnr3qWzyA26b8JyecfWoYWtNSKY8LWeg==',key_name='tempest-keypair-1719862187',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:13:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='380e448092474d8d85b91b431adf9ee6',ramdisk_id='',reservation_id='r-gsy36rf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1985198008',owner_user_name='tempest-VolumesAdminNegativeTest-1985198008-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:13:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb190d4184a94bdd92b148d65dec3956',uuid=1e35c753-7af1-4047-ad06-8b5755207b8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "address": "fa:16:3e:1f:c7:00", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9436b2f8-8b", "ovs_interfaceid": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Converting VIF {"id": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "address": "fa:16:3e:1f:c7:00", "network": {"id": "03e89881-befc-45aa-bd6e-a787212475fe", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1217188394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "380e448092474d8d85b91b431adf9ee6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9436b2f8-8b", "ovs_interfaceid": "9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9436b2f8-8b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG os_vif [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9436b2f8-8b') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9436b2f8-8b, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:19:29 user nova-compute[73520]: INFO os_vif [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2,network=Network(03e89881-befc-45aa-bd6e-a787212475fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9436b2f8-8b')
Aug 16 12:19:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Deleting instance files /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e_del
Aug 16 12:19:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Deletion of /opt/stack/data/nova/instances/1e35c753-7af1-4047-ad06-8b5755207b8e_del complete
Aug 16 12:19:29 user nova-compute[73520]: INFO nova.compute.manager [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 16 12:19:29 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8a594a2-3b9c-424d-9a24-7102d250a72e tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.211s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.network.neutron [req-3d9b57f8-0955-4468-b988-2ea822ab0fb7 req-5568fec7-4306-4561-83ea-b62069200042 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updated VIF entry in instance network info cache for port f9fc71dc-3ee9-497a-a60e-e39046c2d9f3. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG nova.network.neutron [req-3d9b57f8-0955-4468-b988-2ea822ab0fb7 req-5568fec7-4306-4561-83ea-b62069200042 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updating instance_info_cache with network_info: [{"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:29 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:19:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3d9b57f8-0955-4468-b988-2ea822ab0fb7 req-5568fec7-4306-4561-83ea-b62069200042 service nova] Releasing lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:30 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:19:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-600eb2c5-61a9-4573-a938-d849c767fc29 req-7ab9ba9c-c1e7-4d51-91f6-56ba93ad9f40 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Received event network-vif-plugged-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-600eb2c5-61a9-4573-a938-d849c767fc29 req-7ab9ba9c-c1e7-4d51-91f6-56ba93ad9f40 service nova] Acquiring lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-600eb2c5-61a9-4573-a938-d849c767fc29 req-7ab9ba9c-c1e7-4d51-91f6-56ba93ad9f40 service nova] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-600eb2c5-61a9-4573-a938-d849c767fc29 req-7ab9ba9c-c1e7-4d51-91f6-56ba93ad9f40 service nova] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-600eb2c5-61a9-4573-a938-d849c767fc29 req-7ab9ba9c-c1e7-4d51-91f6-56ba93ad9f40 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] No waiting events found dispatching network-vif-plugged-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:31 user nova-compute[73520]: WARNING nova.compute.manager [req-600eb2c5-61a9-4573-a938-d849c767fc29 req-7ab9ba9c-c1e7-4d51-91f6-56ba93ad9f40 service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Received unexpected event network-vif-plugged-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 for instance with vm_state active and task_state deleting.
Aug 16 12:19:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-5b7a9929-740f-4aaf-b3d1-42c0a5e6c6ff req-d9acd257-22b8-4eb1-a79c-b0e4c5c65f48 service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Received event network-vif-plugged-37d3de01-eaaf-4b05-b262-2a5359a07310 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5b7a9929-740f-4aaf-b3d1-42c0a5e6c6ff req-d9acd257-22b8-4eb1-a79c-b0e4c5c65f48 service nova] Acquiring lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5b7a9929-740f-4aaf-b3d1-42c0a5e6c6ff req-d9acd257-22b8-4eb1-a79c-b0e4c5c65f48 service nova] Lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5b7a9929-740f-4aaf-b3d1-42c0a5e6c6ff req-d9acd257-22b8-4eb1-a79c-b0e4c5c65f48 service nova] Lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-5b7a9929-740f-4aaf-b3d1-42c0a5e6c6ff req-d9acd257-22b8-4eb1-a79c-b0e4c5c65f48 service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] No waiting events found dispatching network-vif-plugged-37d3de01-eaaf-4b05-b262-2a5359a07310 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:31 user nova-compute[73520]: WARNING nova.compute.manager [req-5b7a9929-740f-4aaf-b3d1-42c0a5e6c6ff req-d9acd257-22b8-4eb1-a79c-b0e4c5c65f48 service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Received unexpected event network-vif-plugged-37d3de01-eaaf-4b05-b262-2a5359a07310 for instance with vm_state building and task_state spawning.
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "70eeda03-767e-4c60-b535-9b250b63513b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "70eeda03-767e-4c60-b535-9b250b63513b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG nova.compute.manager [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:31 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Took 2.16 seconds to deallocate network for instance.
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188372.14094, 4aec6c13-9121-4c61-9844-d28d420fde09 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:32 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] VM Resumed (Lifecycle Event)
Aug 16 12:19:32 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Instance spawned successfully.
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:32 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188372.1412687, 4aec6c13-9121-4c61-9844-d28d420fde09 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:32 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] VM Started (Lifecycle Event)
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:19:32 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:19:32 user nova-compute[73520]: INFO nova.compute.manager [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Took 8.29 seconds to spawn the instance on the hypervisor.
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:32 user nova-compute[73520]: INFO nova.compute.manager [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Took 9.25 seconds to build instance.
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f550aebd-fda9-4f13-8401-c7cb9c9a0fa5 tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "4aec6c13-9121-4c61-9844-d28d420fde09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.358s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.528s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.519s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:19:32 user nova-compute[73520]: INFO nova.compute.claims [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Claim successful on node user
Aug 16 12:19:32 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Deleted allocations for instance 1e35c753-7af1-4047-ad06-8b5755207b8e
Aug 16 12:19:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fabd1750-957f-461c-a225-aee96ef4ba01 tempest-VolumesAdminNegativeTest-1985198008 tempest-VolumesAdminNegativeTest-1985198008-project-member] Lock "1e35c753-7af1-4047-ad06-8b5755207b8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.343s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:19:32 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.032s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG nova.network.neutron [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:19:33 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:19:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG nova.policy [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6426c917725745038fdb1d03fec4a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1059841e2ee04ca4870497a1ec60bcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:19:33 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Creating image(s)
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "/opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "/opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "/opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.357s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-eabe4360-4002-462c-9319-b1dbb8e032ae req-d553c92c-0771-4f8e-949e-75e9a1c001ca service nova] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Received event network-vif-deleted-9436b2f8-8b2f-4501-b1f1-1d88dfe4aeb2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.252s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.235s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk 1073741824" returned: 0 in 0.109s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG nova.network.neutron [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Successfully created port: fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.245s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Cannot resize image /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'migration_context' on Instance uuid 70eeda03-767e-4c60-b535-9b250b63513b {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Ensure instance console log exists: /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG nova.network.neutron [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Successfully updated port: fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "refresh_cache-70eeda03-767e-4c60-b535-9b250b63513b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquired lock "refresh_cache-70eeda03-767e-4c60-b535-9b250b63513b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG nova.network.neutron [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-88c696db-c61b-4d01-87b7-4995ceee2cd5 req-7e7129df-12d7-4c42-a5de-83ef2f977aae service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Received event network-changed-fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-88c696db-c61b-4d01-87b7-4995ceee2cd5 req-7e7129df-12d7-4c42-a5de-83ef2f977aae service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Refreshing instance network info cache due to event network-changed-fa463141-b9cd-48a7-98ec-d36b007f4f5b. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-88c696db-c61b-4d01-87b7-4995ceee2cd5 req-7e7129df-12d7-4c42-a5de-83ef2f977aae service nova] Acquiring lock "refresh_cache-70eeda03-767e-4c60-b535-9b250b63513b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG nova.network.neutron [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.network.neutron [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Updating instance_info_cache with network_info: [{"id": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "address": "fa:16:3e:3c:be:f7", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa463141-b9", "ovs_interfaceid": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Releasing lock "refresh_cache-70eeda03-767e-4c60-b535-9b250b63513b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Instance network_info: |[{"id": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "address": "fa:16:3e:3c:be:f7", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa463141-b9", "ovs_interfaceid": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-88c696db-c61b-4d01-87b7-4995ceee2cd5 req-7e7129df-12d7-4c42-a5de-83ef2f977aae service nova] Acquired lock "refresh_cache-70eeda03-767e-4c60-b535-9b250b63513b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.network.neutron [req-88c696db-c61b-4d01-87b7-4995ceee2cd5 req-7e7129df-12d7-4c42-a5de-83ef2f977aae service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Refreshing network info cache for port fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Start _get_guest_xml network_info=[{"id": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "address": "fa:16:3e:3c:be:f7", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa463141-b9", "ovs_interfaceid": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:19:36 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:19:36 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1622165131',display_name='tempest-AttachVolumeNegativeTest-server-1622165131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1622165131',id=21,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcVBXOJWiflyDxuT+i9xkLqvQGPKdKNI3Z8LN87Nv2wgZlkzI4EZe1cEExZs1byWRLjn2wsQlfsq/ZJUOlnmmWfx8tSoe/3WYVGc5XBNrNGCZ4dbr0+EHx2SGhdbbYPdA==',key_name='tempest-keypair-1539971069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1059841e2ee04ca4870497a1ec60bcaa',ramdisk_id='',reservation_id='r-aq3tbst7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1618912538',owner_user_name='tempest-AttachVolumeNegativeTest-1618912538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6426c917725745038fdb1d03fec4a2fd',uuid=70eeda03-767e-4c60-b535-9b250b63513b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "address": "fa:16:3e:3c:be:f7", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa463141-b9", "ovs_interfaceid": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converting VIF {"id": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "address": "fa:16:3e:3c:be:f7", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa463141-b9", "ovs_interfaceid": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:be:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa463141-b9cd-48a7-98ec-d36b007f4f5b,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa463141-b9') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'pci_devices' on Instance uuid 70eeda03-767e-4c60-b535-9b250b63513b {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:19:36 user nova-compute[73520]:   <uuid>70eeda03-767e-4c60-b535-9b250b63513b</uuid>
Aug 16 12:19:36 user nova-compute[73520]:   <name>instance-00000015</name>
Aug 16 12:19:36 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:19:36 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:19:36 user nova-compute[73520]:   <metadata>
Aug 16 12:19:36 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:19:36 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:19:36 user nova-compute[73520]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1622165131</nova:name>
Aug 16 12:19:36 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:19:36</nova:creationTime>
Aug 16 12:19:36 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:19:36 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:19:36 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:19:36 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:19:36 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:19:36 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:19:36 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:19:36 user nova-compute[73520]:       <nova:owner>
Aug 16 12:19:36 user nova-compute[73520]:         <nova:user uuid="6426c917725745038fdb1d03fec4a2fd">tempest-AttachVolumeNegativeTest-1618912538-project-member</nova:user>
Aug 16 12:19:36 user nova-compute[73520]:         <nova:project uuid="1059841e2ee04ca4870497a1ec60bcaa">tempest-AttachVolumeNegativeTest-1618912538</nova:project>
Aug 16 12:19:36 user nova-compute[73520]:       </nova:owner>
Aug 16 12:19:36 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:19:36 user nova-compute[73520]:       <nova:ports>
Aug 16 12:19:36 user nova-compute[73520]:         <nova:port uuid="fa463141-b9cd-48a7-98ec-d36b007f4f5b">
Aug 16 12:19:36 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 12:19:36 user nova-compute[73520]:         </nova:port>
Aug 16 12:19:36 user nova-compute[73520]:       </nova:ports>
Aug 16 12:19:36 user nova-compute[73520]:     </nova:instance>
Aug 16 12:19:36 user nova-compute[73520]:   </metadata>
Aug 16 12:19:36 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:19:36 user nova-compute[73520]:     <system>
Aug 16 12:19:36 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:19:36 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:19:36 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:19:36 user nova-compute[73520]:       <entry name="serial">70eeda03-767e-4c60-b535-9b250b63513b</entry>
Aug 16 12:19:36 user nova-compute[73520]:       <entry name="uuid">70eeda03-767e-4c60-b535-9b250b63513b</entry>
Aug 16 12:19:36 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:19:36 user nova-compute[73520]:     </system>
Aug 16 12:19:36 user nova-compute[73520]:   </sysinfo>
Aug 16 12:19:36 user nova-compute[73520]:   <os>
Aug 16 12:19:36 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:19:36 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:19:36 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:19:36 user nova-compute[73520]:   </os>
Aug 16 12:19:36 user nova-compute[73520]:   <features>
Aug 16 12:19:36 user nova-compute[73520]:     <acpi/>
Aug 16 12:19:36 user nova-compute[73520]:     <apic/>
Aug 16 12:19:36 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:19:36 user nova-compute[73520]:   </features>
Aug 16 12:19:36 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:19:36 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:19:36 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:19:36 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:19:36 user nova-compute[73520]:   </clock>
Aug 16 12:19:36 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:19:36 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:19:36 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:19:36 user nova-compute[73520]:   </cpu>
Aug 16 12:19:36 user nova-compute[73520]:   <devices>
Aug 16 12:19:36 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:19:36 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:19:36 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk"/>
Aug 16 12:19:36 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:19:36 user nova-compute[73520]:     </disk>
Aug 16 12:19:36 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:19:36 user nova-compute[73520]:       <mac address="fa:16:3e:3c:be:f7"/>
Aug 16 12:19:36 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:19:36 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:19:36 user nova-compute[73520]:       <target dev="tapfa463141-b9"/>
Aug 16 12:19:36 user nova-compute[73520]:     </interface>
Aug 16 12:19:36 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:19:36 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/console.log" append="off"/>
Aug 16 12:19:36 user nova-compute[73520]:     </serial>
Aug 16 12:19:36 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:19:36 user nova-compute[73520]:     <video>
Aug 16 12:19:36 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:19:36 user nova-compute[73520]:     </video>
Aug 16 12:19:36 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:19:36 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:19:36 user nova-compute[73520]:     </rng>
Aug 16 12:19:36 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:19:36 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:19:36 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:19:36 user nova-compute[73520]:     </memballoon>
Aug 16 12:19:36 user nova-compute[73520]:   </devices>
Aug 16 12:19:36 user nova-compute[73520]: </domain>
Aug 16 12:19:36 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1622165131',display_name='tempest-AttachVolumeNegativeTest-server-1622165131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1622165131',id=21,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcVBXOJWiflyDxuT+i9xkLqvQGPKdKNI3Z8LN87Nv2wgZlkzI4EZe1cEExZs1byWRLjn2wsQlfsq/ZJUOlnmmWfx8tSoe/3WYVGc5XBNrNGCZ4dbr0+EHx2SGhdbbYPdA==',key_name='tempest-keypair-1539971069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1059841e2ee04ca4870497a1ec60bcaa',ramdisk_id='',reservation_id='r-aq3tbst7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1618912538',owner_user_name='tempest-AttachVolumeNegativeTest-1618912538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6426c917725745038fdb1d03fec4a2fd',uuid=70eeda03-767e-4c60-b535-9b250b63513b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "address": "fa:16:3e:3c:be:f7", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa463141-b9", "ovs_interfaceid": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converting VIF {"id": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "address": "fa:16:3e:3c:be:f7", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa463141-b9", "ovs_interfaceid": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:be:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa463141-b9cd-48a7-98ec-d36b007f4f5b,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa463141-b9') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG os_vif [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:be:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa463141-b9cd-48a7-98ec-d36b007f4f5b,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa463141-b9') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa463141-b9, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa463141-b9, col_values=(('external_ids', {'iface-id': 'fa463141-b9cd-48a7-98ec-d36b007f4f5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:be:f7', 'vm-uuid': '70eeda03-767e-4c60-b535-9b250b63513b'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:19:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:36 user nova-compute[73520]: INFO os_vif [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:be:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa463141-b9cd-48a7-98ec-d36b007f4f5b,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa463141-b9')
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188361.5864413, b58731e0-399d-4f8d-84b8-af12a46cf87f => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:37 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] VM Stopped (Lifecycle Event)
Aug 16 12:19:37 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:19:37 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7670MB free_disk=25.557979583740234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-1614cd40-1a8a-4ce5-ba65-0efa18b489cc None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No VIF found with MAC fa:16:3e:3c:be:f7, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance df229b3d-196d-4764-b896-19c882d27d17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 91e479f7-5fc0-46d2-9c02-52175084fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4aec6c13-9121-4c61-9844-d28d420fde09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 70eeda03-767e-4c60-b535-9b250b63513b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.network.neutron [req-88c696db-c61b-4d01-87b7-4995ceee2cd5 req-7e7129df-12d7-4c42-a5de-83ef2f977aae service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Updated VIF entry in instance network info cache for port fa463141-b9cd-48a7-98ec-d36b007f4f5b. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.network.neutron [req-88c696db-c61b-4d01-87b7-4995ceee2cd5 req-7e7129df-12d7-4c42-a5de-83ef2f977aae service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Updating instance_info_cache with network_info: [{"id": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "address": "fa:16:3e:3c:be:f7", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa463141-b9", "ovs_interfaceid": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-88c696db-c61b-4d01-87b7-4995ceee2cd5 req-7e7129df-12d7-4c42-a5de-83ef2f977aae service nova] Releasing lock "refresh_cache-70eeda03-767e-4c60-b535-9b250b63513b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:19:37 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Creating image(s)
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Ensure instance console log exists: /opt/stack/data/nova/instances/df229b3d-196d-4764-b896-19c882d27d17/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Start _get_guest_xml network_info=[{"id": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "address": "fa:16:3e:64:7c:58", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ccfcb5-97", "ovs_interfaceid": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzqMWoCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df229b3d-196d-4764-b896-19c882d27d17', 'attached_at': '', 'detached_at': '', 'volume_id': '3f2d46de-23e7-4659-96bb-d6cebb7fb72a', 'serial': '3f2d46de-23e7-4659-96bb-d6cebb7fb72a'}, 'attachment_id': 'a9f21596-04ad-4c84-b1e7-59bab062912a', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:19:37 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:19:37 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:19:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzqMWoCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:19:38 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:19:38 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:19:38 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0bbcdc-d6b5-4639-a517-78abddf65193]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:19:38 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[424d23f8-add7-4291-a825-f9658ee7e0f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a] added
Aug 16 12:19:38 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bca723-c260-4ab3-a1a9-0fbc603a400c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d791869d-e8f6-4c70-a124-9bbf28605036]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzqMWoCv {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzqMWoCv" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dd0474-998f-43a9-a2dd-56c79f8c0577]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EzqMWoCv'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[db946bad-412f-43c0-9985-ead1c0341690]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1531a568-d823-4bb6-bf48-3015499dd72c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:19:38 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:19:38 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad20ef46-2740-4226-a163-d6edbaaba6d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a, portal: 172.16.0.220,3260]
Aug 16 12:19:38 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a, portal: 172.16.0.220,3260] successful.
Aug 16 12:19:38 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43d42c5-fd34-4346-8d08-250a215c4048]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[065c3062-e326-4230-9a76-93c1012fd910]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:19:38 user nova-compute[73520]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a (non-flash)
Aug 16 12:19:38 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:19:38 user nova-compute[73520]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a (non-flash)
Aug 16 12:19:38 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58deeb6-6b3b-464f-b019-2de221f33b49]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzqMWoCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: df229b3d-196d-4764-b896-19c882d27d17] Skipping network cache update for instance because it is Building. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 12:19:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Skipping network cache update for instance because it is Building. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-6598126e-9870-4473-8812-158b1f28e1b6 req-99f2c3be-319f-43f4-8a19-4e30996c6a59 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Received event network-vif-plugged-fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6598126e-9870-4473-8812-158b1f28e1b6 req-99f2c3be-319f-43f4-8a19-4e30996c6a59 service nova] Acquiring lock "70eeda03-767e-4c60-b535-9b250b63513b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6598126e-9870-4473-8812-158b1f28e1b6 req-99f2c3be-319f-43f4-8a19-4e30996c6a59 service nova] Lock "70eeda03-767e-4c60-b535-9b250b63513b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6598126e-9870-4473-8812-158b1f28e1b6 req-99f2c3be-319f-43f4-8a19-4e30996c6a59 service nova] Lock "70eeda03-767e-4c60-b535-9b250b63513b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-6598126e-9870-4473-8812-158b1f28e1b6 req-99f2c3be-319f-43f4-8a19-4e30996c6a59 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] No waiting events found dispatching network-vif-plugged-fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:39 user nova-compute[73520]: WARNING nova.compute.manager [req-6598126e-9870-4473-8812-158b1f28e1b6 req-99f2c3be-319f-43f4-8a19-4e30996c6a59 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Received unexpected event network-vif-plugged-fa463141-b9cd-48a7-98ec-d36b007f4f5b for instance with vm_state building and task_state spawning.
Aug 16 12:19:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26436336530613365', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436336530613365', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-909796544',display_name='tempest-TestVolumeBootPattern-server-909796544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-909796544',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-w5seepkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:19:06Z,user_data=None,user_id='17ed1823b0de433ab523470e235fdd72',uuid=df229b3d-196d-4764-b896-19c882d27d17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "address": "fa:16:3e:64:7c:58", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ccfcb5-97", "ovs_interfaceid": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "address": "fa:16:3e:64:7c:58", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ccfcb5-97", "ovs_interfaceid": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:7c:58,bridge_name='br-int',has_traffic_filtering=True,id=a1ccfcb5-97a3-4526-aabd-ade6796398f3,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ccfcb5-97') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.objects.instance [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lazy-loading 'pci_devices' on Instance uuid df229b3d-196d-4764-b896-19c882d27d17 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:19:39 user nova-compute[73520]:   <uuid>df229b3d-196d-4764-b896-19c882d27d17</uuid>
Aug 16 12:19:39 user nova-compute[73520]:   <name>instance-00000012</name>
Aug 16 12:19:39 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:19:39 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:19:39 user nova-compute[73520]:   <metadata>
Aug 16 12:19:39 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:19:39 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:19:39 user nova-compute[73520]:       <nova:name>tempest-TestVolumeBootPattern-server-909796544</nova:name>
Aug 16 12:19:39 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:19:37</nova:creationTime>
Aug 16 12:19:39 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:19:39 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:19:39 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:19:39 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:19:39 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:19:39 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:19:39 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:19:39 user nova-compute[73520]:       <nova:owner>
Aug 16 12:19:39 user nova-compute[73520]:         <nova:user uuid="17ed1823b0de433ab523470e235fdd72">tempest-TestVolumeBootPattern-496055159-project-member</nova:user>
Aug 16 12:19:39 user nova-compute[73520]:         <nova:project uuid="a693cd27934644be8e64731417c66783">tempest-TestVolumeBootPattern-496055159</nova:project>
Aug 16 12:19:39 user nova-compute[73520]:       </nova:owner>
Aug 16 12:19:39 user nova-compute[73520]:       <nova:ports>
Aug 16 12:19:39 user nova-compute[73520]:         <nova:port uuid="a1ccfcb5-97a3-4526-aabd-ade6796398f3">
Aug 16 12:19:39 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 12:19:39 user nova-compute[73520]:         </nova:port>
Aug 16 12:19:39 user nova-compute[73520]:       </nova:ports>
Aug 16 12:19:39 user nova-compute[73520]:     </nova:instance>
Aug 16 12:19:39 user nova-compute[73520]:   </metadata>
Aug 16 12:19:39 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:19:39 user nova-compute[73520]:     <system>
Aug 16 12:19:39 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:19:39 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:19:39 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:19:39 user nova-compute[73520]:       <entry name="serial">df229b3d-196d-4764-b896-19c882d27d17</entry>
Aug 16 12:19:39 user nova-compute[73520]:       <entry name="uuid">df229b3d-196d-4764-b896-19c882d27d17</entry>
Aug 16 12:19:39 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:19:39 user nova-compute[73520]:     </system>
Aug 16 12:19:39 user nova-compute[73520]:   </sysinfo>
Aug 16 12:19:39 user nova-compute[73520]:   <os>
Aug 16 12:19:39 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:19:39 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:19:39 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:19:39 user nova-compute[73520]:   </os>
Aug 16 12:19:39 user nova-compute[73520]:   <features>
Aug 16 12:19:39 user nova-compute[73520]:     <acpi/>
Aug 16 12:19:39 user nova-compute[73520]:     <apic/>
Aug 16 12:19:39 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:19:39 user nova-compute[73520]:   </features>
Aug 16 12:19:39 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:19:39 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:19:39 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:19:39 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:19:39 user nova-compute[73520]:   </clock>
Aug 16 12:19:39 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:19:39 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:19:39 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:19:39 user nova-compute[73520]:   </cpu>
Aug 16 12:19:39 user nova-compute[73520]:   <devices>
Aug 16 12:19:39 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:19:39 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:19:39 user nova-compute[73520]:       <source dev="/dev/sdb"/>
Aug 16 12:19:39 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:19:39 user nova-compute[73520]:       <serial>3f2d46de-23e7-4659-96bb-d6cebb7fb72a</serial>
Aug 16 12:19:39 user nova-compute[73520]:     </disk>
Aug 16 12:19:39 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:19:39 user nova-compute[73520]:       <mac address="fa:16:3e:64:7c:58"/>
Aug 16 12:19:39 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:19:39 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:19:39 user nova-compute[73520]:       <target dev="tapa1ccfcb5-97"/>
Aug 16 12:19:39 user nova-compute[73520]:     </interface>
Aug 16 12:19:39 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:19:39 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/df229b3d-196d-4764-b896-19c882d27d17/console.log" append="off"/>
Aug 16 12:19:39 user nova-compute[73520]:     </serial>
Aug 16 12:19:39 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:19:39 user nova-compute[73520]:     <video>
Aug 16 12:19:39 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:19:39 user nova-compute[73520]:     </video>
Aug 16 12:19:39 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:19:39 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:19:39 user nova-compute[73520]:     </rng>
Aug 16 12:19:39 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:19:39 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:19:39 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:19:39 user nova-compute[73520]:     </memballoon>
Aug 16 12:19:39 user nova-compute[73520]:   </devices>
Aug 16 12:19:39 user nova-compute[73520]: </domain>
Aug 16 12:19:39 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-909796544',display_name='tempest-TestVolumeBootPattern-server-909796544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-909796544',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-w5seepkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:19:06Z,user_data=None,user_id='17ed1823b0de433ab523470e235fdd72',uuid=df229b3d-196d-4764-b896-19c882d27d17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "address": "fa:16:3e:64:7c:58", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ccfcb5-97", "ovs_interfaceid": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "address": "fa:16:3e:64:7c:58", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ccfcb5-97", "ovs_interfaceid": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:7c:58,bridge_name='br-int',has_traffic_filtering=True,id=a1ccfcb5-97a3-4526-aabd-ade6796398f3,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ccfcb5-97') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG os_vif [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:7c:58,bridge_name='br-int',has_traffic_filtering=True,id=a1ccfcb5-97a3-4526-aabd-ade6796398f3,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ccfcb5-97') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1ccfcb5-97, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1ccfcb5-97, col_values=(('external_ids', {'iface-id': 'a1ccfcb5-97a3-4526-aabd-ade6796398f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:7c:58', 'vm-uuid': 'df229b3d-196d-4764-b896-19c882d27d17'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:39 user nova-compute[73520]: INFO os_vif [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:7c:58,bridge_name='br-int',has_traffic_filtering=True,id=a1ccfcb5-97a3-4526-aabd-ade6796398f3,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ccfcb5-97')
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] No VIF found with MAC fa:16:3e:64:7c:58, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:40 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updating instance_info_cache with network_info: [{"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:40 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:19:40 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-e9e2ab27-f0de-440f-98a4-4126706c3ac7 req-b73728af-9451-42ad-930b-64cc7a66c374 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Received event network-vif-plugged-fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e9e2ab27-f0de-440f-98a4-4126706c3ac7 req-b73728af-9451-42ad-930b-64cc7a66c374 service nova] Acquiring lock "70eeda03-767e-4c60-b535-9b250b63513b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e9e2ab27-f0de-440f-98a4-4126706c3ac7 req-b73728af-9451-42ad-930b-64cc7a66c374 service nova] Lock "70eeda03-767e-4c60-b535-9b250b63513b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e9e2ab27-f0de-440f-98a4-4126706c3ac7 req-b73728af-9451-42ad-930b-64cc7a66c374 service nova] Lock "70eeda03-767e-4c60-b535-9b250b63513b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-e9e2ab27-f0de-440f-98a4-4126706c3ac7 req-b73728af-9451-42ad-930b-64cc7a66c374 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] No waiting events found dispatching network-vif-plugged-fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:41 user nova-compute[73520]: WARNING nova.compute.manager [req-e9e2ab27-f0de-440f-98a4-4126706c3ac7 req-b73728af-9451-42ad-930b-64cc7a66c374 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Received unexpected event network-vif-plugged-fa463141-b9cd-48a7-98ec-d36b007f4f5b for instance with vm_state building and task_state spawning.
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188381.2098308, 70eeda03-767e-4c60-b535-9b250b63513b => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] VM Resumed (Lifecycle Event)
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:19:41 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Instance spawned successfully.
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188381.2126684, 70eeda03-767e-4c60-b535-9b250b63513b => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] VM Started (Lifecycle Event)
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:19:41 user nova-compute[73520]: INFO nova.compute.manager [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Took 8.07 seconds to spawn the instance on the hypervisor.
Aug 16 12:19:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:19:41 user nova-compute[73520]: INFO nova.compute.manager [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Took 9.67 seconds to build instance.
Aug 16 12:19:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fc7acc83-b0f9-49d8-a3ac-b51c4d975681 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "70eeda03-767e-4c60-b535-9b250b63513b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.004s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-aa93b14a-37fd-4b6b-a58c-a3ea28455e85 req-bc67d72f-4935-4940-9d5b-71b4eaeccbac service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Received event network-vif-plugged-a1ccfcb5-97a3-4526-aabd-ade6796398f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-aa93b14a-37fd-4b6b-a58c-a3ea28455e85 req-bc67d72f-4935-4940-9d5b-71b4eaeccbac service nova] Acquiring lock "df229b3d-196d-4764-b896-19c882d27d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-aa93b14a-37fd-4b6b-a58c-a3ea28455e85 req-bc67d72f-4935-4940-9d5b-71b4eaeccbac service nova] Lock "df229b3d-196d-4764-b896-19c882d27d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-aa93b14a-37fd-4b6b-a58c-a3ea28455e85 req-bc67d72f-4935-4940-9d5b-71b4eaeccbac service nova] Lock "df229b3d-196d-4764-b896-19c882d27d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-aa93b14a-37fd-4b6b-a58c-a3ea28455e85 req-bc67d72f-4935-4940-9d5b-71b4eaeccbac service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] No waiting events found dispatching network-vif-plugged-a1ccfcb5-97a3-4526-aabd-ade6796398f3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:43 user nova-compute[73520]: WARNING nova.compute.manager [req-aa93b14a-37fd-4b6b-a58c-a3ea28455e85 req-bc67d72f-4935-4940-9d5b-71b4eaeccbac service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Received unexpected event network-vif-plugged-a1ccfcb5-97a3-4526-aabd-ade6796398f3 for instance with vm_state building and task_state spawning.
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-aa93b14a-37fd-4b6b-a58c-a3ea28455e85 req-bc67d72f-4935-4940-9d5b-71b4eaeccbac service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Received event network-vif-plugged-a1ccfcb5-97a3-4526-aabd-ade6796398f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-aa93b14a-37fd-4b6b-a58c-a3ea28455e85 req-bc67d72f-4935-4940-9d5b-71b4eaeccbac service nova] Acquiring lock "df229b3d-196d-4764-b896-19c882d27d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-aa93b14a-37fd-4b6b-a58c-a3ea28455e85 req-bc67d72f-4935-4940-9d5b-71b4eaeccbac service nova] Lock "df229b3d-196d-4764-b896-19c882d27d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-aa93b14a-37fd-4b6b-a58c-a3ea28455e85 req-bc67d72f-4935-4940-9d5b-71b4eaeccbac service nova] Lock "df229b3d-196d-4764-b896-19c882d27d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-aa93b14a-37fd-4b6b-a58c-a3ea28455e85 req-bc67d72f-4935-4940-9d5b-71b4eaeccbac service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] No waiting events found dispatching network-vif-plugged-a1ccfcb5-97a3-4526-aabd-ade6796398f3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:43 user nova-compute[73520]: WARNING nova.compute.manager [req-aa93b14a-37fd-4b6b-a58c-a3ea28455e85 req-bc67d72f-4935-4940-9d5b-71b4eaeccbac service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Received unexpected event network-vif-plugged-a1ccfcb5-97a3-4526-aabd-ade6796398f3 for instance with vm_state building and task_state spawning.
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188383.6053424, df229b3d-196d-4764-b896-19c882d27d17 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:43 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: df229b3d-196d-4764-b896-19c882d27d17] VM Resumed (Lifecycle Event)
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:19:43 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: df229b3d-196d-4764-b896-19c882d27d17] Instance spawned successfully.
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: df229b3d-196d-4764-b896-19c882d27d17] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: df229b3d-196d-4764-b896-19c882d27d17] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:19:43 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: df229b3d-196d-4764-b896-19c882d27d17] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188383.6061625, df229b3d-196d-4764-b896-19c882d27d17 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:43 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: df229b3d-196d-4764-b896-19c882d27d17] VM Started (Lifecycle Event)
Aug 16 12:19:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: df229b3d-196d-4764-b896-19c882d27d17] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: df229b3d-196d-4764-b896-19c882d27d17] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:19:43 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: df229b3d-196d-4764-b896-19c882d27d17] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:19:43 user nova-compute[73520]: INFO nova.compute.manager [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Took 5.85 seconds to spawn the instance on the hypervisor.
Aug 16 12:19:43 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:43 user nova-compute[73520]: INFO nova.compute.manager [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Took 38.33 seconds to build instance.
Aug 16 12:19:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf6d7ce2-08d0-408c-8c44-67a0b4fead8f tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "df229b3d-196d-4764-b896-19c882d27d17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.507s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:44 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188369.4150512, 1e35c753-7af1-4047-ad06-8b5755207b8e => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:44 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] VM Stopped (Lifecycle Event)
Aug 16 12:19:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-debee9e0-de66-4794-89d1-65b52b3c21e8 None None] [instance: 1e35c753-7af1-4047-ad06-8b5755207b8e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "9ab085c8-d666-4525-bee5-d61aada89a7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:19:52 user nova-compute[73520]: INFO nova.compute.claims [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Claim successful on node user
Aug 16 12:19:52 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG nova.network.neutron [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:19:52 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:19:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG nova.policy [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'deb886afd1c74c7faf40093c363f2003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5436806c15a841fa8b3caec7bc2c60a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:19:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:19:52 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Creating image(s)
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "/opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "/opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.198s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk 1073741824" returned: 0 in 0.082s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG nova.network.neutron [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Successfully created port: 4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.232s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Cannot resize image /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG nova.objects.instance [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lazy-loading 'migration_context' on Instance uuid 9ab085c8-d666-4525-bee5-d61aada89a7a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Ensure instance console log exists: /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.network.neutron [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Successfully updated port: 4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "refresh_cache-9ab085c8-d666-4525-bee5-d61aada89a7a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquired lock "refresh_cache-9ab085c8-d666-4525-bee5-d61aada89a7a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.network.neutron [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-f56b56b2-b218-439f-9afe-6f5392fe518b req-2e24cb13-d0b2-483a-b4af-fa3e6dfe09a1 service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Received event network-changed-4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-f56b56b2-b218-439f-9afe-6f5392fe518b req-2e24cb13-d0b2-483a-b4af-fa3e6dfe09a1 service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Refreshing instance network info cache due to event network-changed-4236a073-45ce-42b4-bedd-e568a6ed5ebd. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f56b56b2-b218-439f-9afe-6f5392fe518b req-2e24cb13-d0b2-483a-b4af-fa3e6dfe09a1 service nova] Acquiring lock "refresh_cache-9ab085c8-d666-4525-bee5-d61aada89a7a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.network.neutron [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.network.neutron [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Updating instance_info_cache with network_info: [{"id": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "address": "fa:16:3e:ac:d9:71", "network": {"id": "e1920a82-145c-47c4-ba96-97c266bb7208", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-763027158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5436806c15a841fa8b3caec7bc2c60a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4236a073-45", "ovs_interfaceid": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Releasing lock "refresh_cache-9ab085c8-d666-4525-bee5-d61aada89a7a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Instance network_info: |[{"id": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "address": "fa:16:3e:ac:d9:71", "network": {"id": "e1920a82-145c-47c4-ba96-97c266bb7208", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-763027158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5436806c15a841fa8b3caec7bc2c60a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4236a073-45", "ovs_interfaceid": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f56b56b2-b218-439f-9afe-6f5392fe518b req-2e24cb13-d0b2-483a-b4af-fa3e6dfe09a1 service nova] Acquired lock "refresh_cache-9ab085c8-d666-4525-bee5-d61aada89a7a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.network.neutron [req-f56b56b2-b218-439f-9afe-6f5392fe518b req-2e24cb13-d0b2-483a-b4af-fa3e6dfe09a1 service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Refreshing network info cache for port 4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Start _get_guest_xml network_info=[{"id": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "address": "fa:16:3e:ac:d9:71", "network": {"id": "e1920a82-145c-47c4-ba96-97c266bb7208", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-763027158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5436806c15a841fa8b3caec7bc2c60a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4236a073-45", "ovs_interfaceid": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:19:54 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:19:54 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:19:54 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1534208989',display_name='tempest-TestServerVolumeAttachmentScenario-server-1534208989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1534208989',id=22,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ8j+1y5HzBckSPMamPkoZpNfGqZgxOmSOCq0vhABwKNGb3UqkDpYL8QCjwrHp54ew+zQzBDxkNE2+40hFUNkW8lIwcxecq2SPJ7A1jdvom8S9C/KlPdX15ij386MWq/w==',key_name='tempest-keypair-1854452323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5436806c15a841fa8b3caec7bc2c60a4',ramdisk_id='',reservation_id='r-augwjv69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1869633662',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1869633662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='deb886afd1c74c7faf40093c363f2003',uuid=9ab085c8-d666-4525-bee5-d61aada89a7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "address": "fa:16:3e:ac:d9:71", "network": {"id": "e1920a82-145c-47c4-ba96-97c266bb7208", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-763027158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5436806c15a841fa8b3caec7bc2c60a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4236a073-45", "ovs_interfaceid": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Converting VIF {"id": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "address": "fa:16:3e:ac:d9:71", "network": {"id": "e1920a82-145c-47c4-ba96-97c266bb7208", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-763027158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5436806c15a841fa8b3caec7bc2c60a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4236a073-45", "ovs_interfaceid": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:d9:71,bridge_name='br-int',has_traffic_filtering=True,id=4236a073-45ce-42b4-bedd-e568a6ed5ebd,network=Network(e1920a82-145c-47c4-ba96-97c266bb7208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4236a073-45') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG nova.objects.instance [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ab085c8-d666-4525-bee5-d61aada89a7a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:19:55 user nova-compute[73520]:   <uuid>9ab085c8-d666-4525-bee5-d61aada89a7a</uuid>
Aug 16 12:19:55 user nova-compute[73520]:   <name>instance-00000016</name>
Aug 16 12:19:55 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:19:55 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:19:55 user nova-compute[73520]:   <metadata>
Aug 16 12:19:55 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:19:55 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:19:55 user nova-compute[73520]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1534208989</nova:name>
Aug 16 12:19:55 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:19:54</nova:creationTime>
Aug 16 12:19:55 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:19:55 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:19:55 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:19:55 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:19:55 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:19:55 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:19:55 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:19:55 user nova-compute[73520]:       <nova:owner>
Aug 16 12:19:55 user nova-compute[73520]:         <nova:user uuid="deb886afd1c74c7faf40093c363f2003">tempest-TestServerVolumeAttachmentScenario-1869633662-project-member</nova:user>
Aug 16 12:19:55 user nova-compute[73520]:         <nova:project uuid="5436806c15a841fa8b3caec7bc2c60a4">tempest-TestServerVolumeAttachmentScenario-1869633662</nova:project>
Aug 16 12:19:55 user nova-compute[73520]:       </nova:owner>
Aug 16 12:19:55 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:19:55 user nova-compute[73520]:       <nova:ports>
Aug 16 12:19:55 user nova-compute[73520]:         <nova:port uuid="4236a073-45ce-42b4-bedd-e568a6ed5ebd">
Aug 16 12:19:55 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 12:19:55 user nova-compute[73520]:         </nova:port>
Aug 16 12:19:55 user nova-compute[73520]:       </nova:ports>
Aug 16 12:19:55 user nova-compute[73520]:     </nova:instance>
Aug 16 12:19:55 user nova-compute[73520]:   </metadata>
Aug 16 12:19:55 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:19:55 user nova-compute[73520]:     <system>
Aug 16 12:19:55 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:19:55 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:19:55 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:19:55 user nova-compute[73520]:       <entry name="serial">9ab085c8-d666-4525-bee5-d61aada89a7a</entry>
Aug 16 12:19:55 user nova-compute[73520]:       <entry name="uuid">9ab085c8-d666-4525-bee5-d61aada89a7a</entry>
Aug 16 12:19:55 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:19:55 user nova-compute[73520]:     </system>
Aug 16 12:19:55 user nova-compute[73520]:   </sysinfo>
Aug 16 12:19:55 user nova-compute[73520]:   <os>
Aug 16 12:19:55 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:19:55 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:19:55 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:19:55 user nova-compute[73520]:   </os>
Aug 16 12:19:55 user nova-compute[73520]:   <features>
Aug 16 12:19:55 user nova-compute[73520]:     <acpi/>
Aug 16 12:19:55 user nova-compute[73520]:     <apic/>
Aug 16 12:19:55 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:19:55 user nova-compute[73520]:   </features>
Aug 16 12:19:55 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:19:55 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:19:55 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:19:55 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:19:55 user nova-compute[73520]:   </clock>
Aug 16 12:19:55 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:19:55 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:19:55 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:19:55 user nova-compute[73520]:   </cpu>
Aug 16 12:19:55 user nova-compute[73520]:   <devices>
Aug 16 12:19:55 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:19:55 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:19:55 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk"/>
Aug 16 12:19:55 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:19:55 user nova-compute[73520]:     </disk>
Aug 16 12:19:55 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:19:55 user nova-compute[73520]:       <mac address="fa:16:3e:ac:d9:71"/>
Aug 16 12:19:55 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:19:55 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:19:55 user nova-compute[73520]:       <target dev="tap4236a073-45"/>
Aug 16 12:19:55 user nova-compute[73520]:     </interface>
Aug 16 12:19:55 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:19:55 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/console.log" append="off"/>
Aug 16 12:19:55 user nova-compute[73520]:     </serial>
Aug 16 12:19:55 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:19:55 user nova-compute[73520]:     <video>
Aug 16 12:19:55 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:19:55 user nova-compute[73520]:     </video>
Aug 16 12:19:55 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:19:55 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:19:55 user nova-compute[73520]:     </rng>
Aug 16 12:19:55 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:19:55 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:19:55 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:19:55 user nova-compute[73520]:     </memballoon>
Aug 16 12:19:55 user nova-compute[73520]:   </devices>
Aug 16 12:19:55 user nova-compute[73520]: </domain>
Aug 16 12:19:55 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1534208989',display_name='tempest-TestServerVolumeAttachmentScenario-server-1534208989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1534208989',id=22,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ8j+1y5HzBckSPMamPkoZpNfGqZgxOmSOCq0vhABwKNGb3UqkDpYL8QCjwrHp54ew+zQzBDxkNE2+40hFUNkW8lIwcxecq2SPJ7A1jdvom8S9C/KlPdX15ij386MWq/w==',key_name='tempest-keypair-1854452323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5436806c15a841fa8b3caec7bc2c60a4',ramdisk_id='',reservation_id='r-augwjv69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1869633662',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1869633662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='deb886afd1c74c7faf40093c363f2003',uuid=9ab085c8-d666-4525-bee5-d61aada89a7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "address": "fa:16:3e:ac:d9:71", "network": {"id": "e1920a82-145c-47c4-ba96-97c266bb7208", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-763027158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5436806c15a841fa8b3caec7bc2c60a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4236a073-45", "ovs_interfaceid": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Converting VIF {"id": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "address": "fa:16:3e:ac:d9:71", "network": {"id": "e1920a82-145c-47c4-ba96-97c266bb7208", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-763027158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5436806c15a841fa8b3caec7bc2c60a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4236a073-45", "ovs_interfaceid": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:d9:71,bridge_name='br-int',has_traffic_filtering=True,id=4236a073-45ce-42b4-bedd-e568a6ed5ebd,network=Network(e1920a82-145c-47c4-ba96-97c266bb7208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4236a073-45') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG os_vif [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:d9:71,bridge_name='br-int',has_traffic_filtering=True,id=4236a073-45ce-42b4-bedd-e568a6ed5ebd,network=Network(e1920a82-145c-47c4-ba96-97c266bb7208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4236a073-45') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4236a073-45, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4236a073-45, col_values=(('external_ids', {'iface-id': '4236a073-45ce-42b4-bedd-e568a6ed5ebd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:d9:71', 'vm-uuid': '9ab085c8-d666-4525-bee5-d61aada89a7a'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:55 user nova-compute[73520]: INFO os_vif [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:d9:71,bridge_name='br-int',has_traffic_filtering=True,id=4236a073-45ce-42b4-bedd-e568a6ed5ebd,network=Network(e1920a82-145c-47c4-ba96-97c266bb7208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4236a073-45')
Aug 16 12:19:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] No VIF found with MAC fa:16:3e:ac:d9:71, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG nova.network.neutron [req-f56b56b2-b218-439f-9afe-6f5392fe518b req-2e24cb13-d0b2-483a-b4af-fa3e6dfe09a1 service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Updated VIF entry in instance network info cache for port 4236a073-45ce-42b4-bedd-e568a6ed5ebd. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG nova.network.neutron [req-f56b56b2-b218-439f-9afe-6f5392fe518b req-2e24cb13-d0b2-483a-b4af-fa3e6dfe09a1 service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Updating instance_info_cache with network_info: [{"id": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "address": "fa:16:3e:ac:d9:71", "network": {"id": "e1920a82-145c-47c4-ba96-97c266bb7208", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-763027158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5436806c15a841fa8b3caec7bc2c60a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4236a073-45", "ovs_interfaceid": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:19:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f56b56b2-b218-439f-9afe-6f5392fe518b req-2e24cb13-d0b2-483a-b4af-fa3e6dfe09a1 service nova] Releasing lock "refresh_cache-9ab085c8-d666-4525-bee5-d61aada89a7a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:19:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-97d7e551-3c5c-495c-9029-f26e37415a9e req-17769464-a468-4ef3-9035-3f543f634c0e service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Received event network-vif-plugged-4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-97d7e551-3c5c-495c-9029-f26e37415a9e req-17769464-a468-4ef3-9035-3f543f634c0e service nova] Acquiring lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-97d7e551-3c5c-495c-9029-f26e37415a9e req-17769464-a468-4ef3-9035-3f543f634c0e service nova] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-97d7e551-3c5c-495c-9029-f26e37415a9e req-17769464-a468-4ef3-9035-3f543f634c0e service nova] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-97d7e551-3c5c-495c-9029-f26e37415a9e req-17769464-a468-4ef3-9035-3f543f634c0e service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] No waiting events found dispatching network-vif-plugged-4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:57 user nova-compute[73520]: WARNING nova.compute.manager [req-97d7e551-3c5c-495c-9029-f26e37415a9e req-17769464-a468-4ef3-9035-3f543f634c0e service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Received unexpected event network-vif-plugged-4236a073-45ce-42b4-bedd-e568a6ed5ebd for instance with vm_state building and task_state spawning.
Aug 16 12:19:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188399.161141, 9ab085c8-d666-4525-bee5-d61aada89a7a => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:59 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] VM Resumed (Lifecycle Event)
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:19:59 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Instance spawned successfully.
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-32cd7ce2-830f-4971-8298-0f64898011dd req-ecd324b7-80d7-47ce-9ad5-0176f39863bf service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Received event network-vif-plugged-4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32cd7ce2-830f-4971-8298-0f64898011dd req-ecd324b7-80d7-47ce-9ad5-0176f39863bf service nova] Acquiring lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32cd7ce2-830f-4971-8298-0f64898011dd req-ecd324b7-80d7-47ce-9ad5-0176f39863bf service nova] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32cd7ce2-830f-4971-8298-0f64898011dd req-ecd324b7-80d7-47ce-9ad5-0176f39863bf service nova] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-32cd7ce2-830f-4971-8298-0f64898011dd req-ecd324b7-80d7-47ce-9ad5-0176f39863bf service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] No waiting events found dispatching network-vif-plugged-4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:19:59 user nova-compute[73520]: WARNING nova.compute.manager [req-32cd7ce2-830f-4971-8298-0f64898011dd req-ecd324b7-80d7-47ce-9ad5-0176f39863bf service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Received unexpected event network-vif-plugged-4236a073-45ce-42b4-bedd-e568a6ed5ebd for instance with vm_state building and task_state spawning.
Aug 16 12:19:59 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188399.1637425, 9ab085c8-d666-4525-bee5-d61aada89a7a => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:19:59 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] VM Started (Lifecycle Event)
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:19:59 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:19:59 user nova-compute[73520]: INFO nova.compute.manager [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 16 12:19:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:19:59 user nova-compute[73520]: INFO nova.compute.manager [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Took 7.19 seconds to build instance.
Aug 16 12:19:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8236a9e0-1de1-49f7-8ef1-80a4e65960cf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.305s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:05 user nova-compute[73520]: INFO nova.compute.manager [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Terminating instance
Aug 16 12:20:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-7cc9a949-b227-4ab3-ae41-ee21c7b5752f req-5dde92af-d434-4c0a-8e88-17e5d010b12b service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-unplugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7cc9a949-b227-4ab3-ae41-ee21c7b5752f req-5dde92af-d434-4c0a-8e88-17e5d010b12b service nova] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7cc9a949-b227-4ab3-ae41-ee21c7b5752f req-5dde92af-d434-4c0a-8e88-17e5d010b12b service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7cc9a949-b227-4ab3-ae41-ee21c7b5752f req-5dde92af-d434-4c0a-8e88-17e5d010b12b service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-7cc9a949-b227-4ab3-ae41-ee21c7b5752f req-5dde92af-d434-4c0a-8e88-17e5d010b12b service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] No waiting events found dispatching network-vif-unplugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:20:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-7cc9a949-b227-4ab3-ae41-ee21c7b5752f req-5dde92af-d434-4c0a-8e88-17e5d010b12b service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-unplugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:20:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:06 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Instance destroyed successfully.
Aug 16 12:20:06 user nova-compute[73520]: DEBUG nova.objects.instance [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lazy-loading 'resources' on Instance uuid 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:20:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1867177793',display_name='tempest-ServerStableDeviceRescueTest-server-1867177793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1867177793',id=2,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW1sULHDOwqYzwZNX8bdrBg2J4hzkPj384swsuGLaI5fdvQMlFCxH9VVU6Igf3uJTT5VzWdM2O6U06SbkepqbwghltsmDpN24/4L4JDgtpUfVbM6sx8uSo4KvWrF9zMfw==',key_name='tempest-keypair-1070714980',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:16:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ecfcad0609442ac978b2f28869a61a2',ramdisk_id='',reservation_id='r-35vu3dd3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-229465501',owner_user_name='tempest-ServerStableDeviceRescueTest-229465501-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92bb596f4b334418913e5aff74e0cd9b',uuid=2a72dbe6-dfc2-4527-8213-c2e9fe2f553a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:20:06 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Converting VIF {"id": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "address": "fa:16:3e:58:a8:3f", "network": {"id": "68120f7a-55c5-44f9-8ba2-7b43fb289064", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1672592849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ecfcad0609442ac978b2f28869a61a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7070f8b-1a", "ovs_interfaceid": "e7070f8b-1a15-4dad-8fac-bd4518007ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:20:06 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:a8:3f,bridge_name='br-int',has_traffic_filtering=True,id=e7070f8b-1a15-4dad-8fac-bd4518007ed3,network=Network(68120f7a-55c5-44f9-8ba2-7b43fb289064),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7070f8b-1a') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:20:06 user nova-compute[73520]: DEBUG os_vif [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:a8:3f,bridge_name='br-int',has_traffic_filtering=True,id=e7070f8b-1a15-4dad-8fac-bd4518007ed3,network=Network(68120f7a-55c5-44f9-8ba2-7b43fb289064),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7070f8b-1a') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:20:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7070f8b-1a, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:20:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:06 user nova-compute[73520]: INFO os_vif [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:a8:3f,bridge_name='br-int',has_traffic_filtering=True,id=e7070f8b-1a15-4dad-8fac-bd4518007ed3,network=Network(68120f7a-55c5-44f9-8ba2-7b43fb289064),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7070f8b-1a')
Aug 16 12:20:06 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Deleting instance files /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a_del
Aug 16 12:20:06 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Deletion of /opt/stack/data/nova/instances/2a72dbe6-dfc2-4527-8213-c2e9fe2f553a_del complete
Aug 16 12:20:06 user nova-compute[73520]: INFO nova.compute.manager [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 16 12:20:06 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:20:06 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:20:06 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:20:07 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:20:07 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Took 1.40 seconds to deallocate network for instance.
Aug 16 12:20:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a203f3e-6cb1-4612-8c6a-957f76b95094 req-949ea0dc-e16e-4cea-8202-6f35d997f5d3 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:20:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a203f3e-6cb1-4612-8c6a-957f76b95094 req-949ea0dc-e16e-4cea-8202-6f35d997f5d3 service nova] Acquiring lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a203f3e-6cb1-4612-8c6a-957f76b95094 req-949ea0dc-e16e-4cea-8202-6f35d997f5d3 service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a203f3e-6cb1-4612-8c6a-957f76b95094 req-949ea0dc-e16e-4cea-8202-6f35d997f5d3 service nova] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a203f3e-6cb1-4612-8c6a-957f76b95094 req-949ea0dc-e16e-4cea-8202-6f35d997f5d3 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] No waiting events found dispatching network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:20:07 user nova-compute[73520]: WARNING nova.compute.manager [req-5a203f3e-6cb1-4612-8c6a-957f76b95094 req-949ea0dc-e16e-4cea-8202-6f35d997f5d3 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received unexpected event network-vif-plugged-e7070f8b-1a15-4dad-8fac-bd4518007ed3 for instance with vm_state active and task_state deleting.
Aug 16 12:20:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-89206f73-6a4b-4eff-a461-93ae6755510b req-92621d82-6846-4cdb-baf8-07bf5fdc6df2 service nova] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Received event network-vif-deleted-e7070f8b-1a15-4dad-8fac-bd4518007ed3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:20:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:08 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:20:08 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:20:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:08 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Deleted allocations for instance 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a
Aug 16 12:20:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56caf43f-a0a8-411f-8b1c-a19c5c9246c1 tempest-ServerStableDeviceRescueTest-229465501 tempest-ServerStableDeviceRescueTest-229465501-project-member] Lock "2a72dbe6-dfc2-4527-8213-c2e9fe2f553a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.147s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:21 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188406.321492, 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:20:21 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] VM Stopped (Lifecycle Event)
Aug 16 12:20:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-686ab73d-e6e4-4fba-9e85-60e729b6b042 None None] [instance: 2a72dbe6-dfc2-4527-8213-c2e9fe2f553a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:20:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:20:28 user nova-compute[73520]: INFO nova.compute.manager [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] instance snapshotting
Aug 16 12:20:28 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Beginning live snapshot process
Aug 16 12:20:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json -f qcow2 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:28 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:20:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json -f qcow2" returned: 0 in 0.210s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json -f qcow2 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvjxiu1od/2b8135f04cfc45b585ce9cc48c58af43.delta 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvjxiu1od/2b8135f04cfc45b585ce9cc48c58af43.delta 1073741824" returned: 0 in 0.058s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 12:20:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:20:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] COPY block job progress, current cursor: 22151168 final cursor: 75497472 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:20:30 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:20:30 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:20:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:20:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:20:31 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 12:20:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:31 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:20:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvjxiu1od/2b8135f04cfc45b585ce9cc48c58af43.delta /opt/stack/data/nova/instances/snapshots/tmpvjxiu1od/2b8135f04cfc45b585ce9cc48c58af43 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvjxiu1od/2b8135f04cfc45b585ce9cc48c58af43.delta /opt/stack/data/nova/instances/snapshots/tmpvjxiu1od/2b8135f04cfc45b585ce9cc48c58af43" returned: 0 in 0.907s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:32 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Snapshot extracted, beginning image upload
Aug 16 12:20:32 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:20:33 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:20:33 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:20:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:33 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:20:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:20:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Snapshot image upload complete
Aug 16 12:20:34 user nova-compute[73520]: INFO nova.compute.manager [None req-4af00451-d838-4024-8b6e-b542a1c8152d tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Took 6.25 seconds to snapshot the instance on the hypervisor.
Aug 16 12:20:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:20:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:37 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:20:37 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7290MB free_disk=25.50860595703125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance df229b3d-196d-4764-b896-19c882d27d17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 91e479f7-5fc0-46d2-9c02-52175084fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4aec6c13-9121-4c61-9844-d28d420fde09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 70eeda03-767e-4c60-b535-9b250b63513b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 9ab085c8-d666-4525-bee5-d61aada89a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:20:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:20:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:20:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:20:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:20:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:20:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:20:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:20:39 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updating instance_info_cache with network_info: [{"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:20:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:20:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:20:39 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:20:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "e3236316-dada-4aee-a210-6d9e9950c166" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:20:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:53 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:20:53 user nova-compute[73520]: INFO nova.compute.claims [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Claim successful on node user
Aug 16 12:20:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:53 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:20:53 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:20:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:20:54 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:20:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG nova.policy [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1830f07ec8441a98454a18fd3a2e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334e1cae88394856b698916811059782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:20:54 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Creating image(s)
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.212s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk 1073741824" returned: 0 in 0.057s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:54 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Successfully created port: 7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:20:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:55 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Cannot resize image /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:20:55 user nova-compute[73520]: DEBUG nova.objects.instance [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lazy-loading 'migration_context' on Instance uuid e3236316-dada-4aee-a210-6d9e9950c166 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:20:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:20:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Ensure instance console log exists: /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:20:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:55 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Successfully updated port: 7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:20:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:20:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquired lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:20:55 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-fba5a15c-cd7d-4af2-b304-e742aaddba3f req-ae683770-b42c-46c7-b678-06dcad3412d9 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-changed-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-fba5a15c-cd7d-4af2-b304-e742aaddba3f req-ae683770-b42c-46c7-b678-06dcad3412d9 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Refreshing instance network info cache due to event network-changed-7af832cf-a4a6-4c84-8ca3-0b578347bbc0. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-fba5a15c-cd7d-4af2-b304-e742aaddba3f req-ae683770-b42c-46c7-b678-06dcad3412d9 service nova] Acquiring lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "df229b3d-196d-4764-b896-19c882d27d17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "df229b3d-196d-4764-b896-19c882d27d17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "df229b3d-196d-4764-b896-19c882d27d17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "df229b3d-196d-4764-b896-19c882d27d17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "df229b3d-196d-4764-b896-19c882d27d17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:56 user nova-compute[73520]: INFO nova.compute.manager [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Terminating instance
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Updating instance_info_cache with network_info: [{"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Releasing lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Instance network_info: |[{"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-fba5a15c-cd7d-4af2-b304-e742aaddba3f req-ae683770-b42c-46c7-b678-06dcad3412d9 service nova] Acquired lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.network.neutron [req-fba5a15c-cd7d-4af2-b304-e742aaddba3f req-ae683770-b42c-46c7-b678-06dcad3412d9 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Refreshing network info cache for port 7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Start _get_guest_xml network_info=[{"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:20:56 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:20:56 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237150177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237150177',id=23,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLqlkeW8K4/NYjRCJM4DThn3bJr4LmJGxj2R3Ahh8DNjzuZ9KWKu2ENvKunjOIly8U/grW0cxfrq3RvxlK8fCQ+TzP/dQAKgugcoqQDuK4pTxhnxyfh+UcCyNr/VbXPmw==',key_name='tempest-keypair-1386297183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='334e1cae88394856b698916811059782',ramdisk_id='',reservation_id='r-kqjagab3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1067579941',owner_user_name='tempest-TaggedAttachmentsTest-1067579941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1830f07ec8441a98454a18fd3a2e5a9',uuid=e3236316-dada-4aee-a210-6d9e9950c166,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converting VIF {"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=7af832cf-a4a6-4c84-8ca3-0b578347bbc0,network=Network(f69a4506-0d64-45bb-999c-cc0ac88b9830),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af832cf-a4') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.objects.instance [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lazy-loading 'pci_devices' on Instance uuid e3236316-dada-4aee-a210-6d9e9950c166 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:20:56 user nova-compute[73520]:   <uuid>e3236316-dada-4aee-a210-6d9e9950c166</uuid>
Aug 16 12:20:56 user nova-compute[73520]:   <name>instance-00000017</name>
Aug 16 12:20:56 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:20:56 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:20:56 user nova-compute[73520]:   <metadata>
Aug 16 12:20:56 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:20:56 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:20:56 user nova-compute[73520]:       <nova:name>tempest-device-tagging-server-1237150177</nova:name>
Aug 16 12:20:56 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:20:56</nova:creationTime>
Aug 16 12:20:56 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:20:56 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:20:56 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:20:56 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:20:56 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:20:56 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:20:56 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:20:56 user nova-compute[73520]:       <nova:owner>
Aug 16 12:20:56 user nova-compute[73520]:         <nova:user uuid="d1830f07ec8441a98454a18fd3a2e5a9">tempest-TaggedAttachmentsTest-1067579941-project-member</nova:user>
Aug 16 12:20:56 user nova-compute[73520]:         <nova:project uuid="334e1cae88394856b698916811059782">tempest-TaggedAttachmentsTest-1067579941</nova:project>
Aug 16 12:20:56 user nova-compute[73520]:       </nova:owner>
Aug 16 12:20:56 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:20:56 user nova-compute[73520]:       <nova:ports>
Aug 16 12:20:56 user nova-compute[73520]:         <nova:port uuid="7af832cf-a4a6-4c84-8ca3-0b578347bbc0">
Aug 16 12:20:56 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 12:20:56 user nova-compute[73520]:         </nova:port>
Aug 16 12:20:56 user nova-compute[73520]:       </nova:ports>
Aug 16 12:20:56 user nova-compute[73520]:     </nova:instance>
Aug 16 12:20:56 user nova-compute[73520]:   </metadata>
Aug 16 12:20:56 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:20:56 user nova-compute[73520]:     <system>
Aug 16 12:20:56 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:20:56 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:20:56 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:20:56 user nova-compute[73520]:       <entry name="serial">e3236316-dada-4aee-a210-6d9e9950c166</entry>
Aug 16 12:20:56 user nova-compute[73520]:       <entry name="uuid">e3236316-dada-4aee-a210-6d9e9950c166</entry>
Aug 16 12:20:56 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:20:56 user nova-compute[73520]:     </system>
Aug 16 12:20:56 user nova-compute[73520]:   </sysinfo>
Aug 16 12:20:56 user nova-compute[73520]:   <os>
Aug 16 12:20:56 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:20:56 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:20:56 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:20:56 user nova-compute[73520]:   </os>
Aug 16 12:20:56 user nova-compute[73520]:   <features>
Aug 16 12:20:56 user nova-compute[73520]:     <acpi/>
Aug 16 12:20:56 user nova-compute[73520]:     <apic/>
Aug 16 12:20:56 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:20:56 user nova-compute[73520]:   </features>
Aug 16 12:20:56 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:20:56 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:20:56 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:20:56 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:20:56 user nova-compute[73520]:   </clock>
Aug 16 12:20:56 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:20:56 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:20:56 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:20:56 user nova-compute[73520]:   </cpu>
Aug 16 12:20:56 user nova-compute[73520]:   <devices>
Aug 16 12:20:56 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:20:56 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:20:56 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk"/>
Aug 16 12:20:56 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:20:56 user nova-compute[73520]:     </disk>
Aug 16 12:20:56 user nova-compute[73520]:     <disk type="file" device="cdrom">
Aug 16 12:20:56 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 12:20:56 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk.config"/>
Aug 16 12:20:56 user nova-compute[73520]:       <target dev="hda" bus="ide"/>
Aug 16 12:20:56 user nova-compute[73520]:     </disk>
Aug 16 12:20:56 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:20:56 user nova-compute[73520]:       <mac address="fa:16:3e:a1:f5:32"/>
Aug 16 12:20:56 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:20:56 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:20:56 user nova-compute[73520]:       <target dev="tap7af832cf-a4"/>
Aug 16 12:20:56 user nova-compute[73520]:     </interface>
Aug 16 12:20:56 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:20:56 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/console.log" append="off"/>
Aug 16 12:20:56 user nova-compute[73520]:     </serial>
Aug 16 12:20:56 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:20:56 user nova-compute[73520]:     <video>
Aug 16 12:20:56 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:20:56 user nova-compute[73520]:     </video>
Aug 16 12:20:56 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:20:56 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:20:56 user nova-compute[73520]:     </rng>
Aug 16 12:20:56 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:20:56 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:20:56 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:20:56 user nova-compute[73520]:     </memballoon>
Aug 16 12:20:56 user nova-compute[73520]:   </devices>
Aug 16 12:20:56 user nova-compute[73520]: </domain>
Aug 16 12:20:56 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237150177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237150177',id=23,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLqlkeW8K4/NYjRCJM4DThn3bJr4LmJGxj2R3Ahh8DNjzuZ9KWKu2ENvKunjOIly8U/grW0cxfrq3RvxlK8fCQ+TzP/dQAKgugcoqQDuK4pTxhnxyfh+UcCyNr/VbXPmw==',key_name='tempest-keypair-1386297183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='334e1cae88394856b698916811059782',ramdisk_id='',reservation_id='r-kqjagab3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1067579941',owner_user_name='tempest-TaggedAttachmentsTest-1067579941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1830f07ec8441a98454a18fd3a2e5a9',uuid=e3236316-dada-4aee-a210-6d9e9950c166,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converting VIF {"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=7af832cf-a4a6-4c84-8ca3-0b578347bbc0,network=Network(f69a4506-0d64-45bb-999c-cc0ac88b9830),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af832cf-a4') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG os_vif [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=7af832cf-a4a6-4c84-8ca3-0b578347bbc0,network=Network(f69a4506-0d64-45bb-999c-cc0ac88b9830),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af832cf-a4') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7af832cf-a4, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7af832cf-a4, col_values=(('external_ids', {'iface-id': '7af832cf-a4a6-4c84-8ca3-0b578347bbc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:f5:32', 'vm-uuid': 'e3236316-dada-4aee-a210-6d9e9950c166'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:56 user nova-compute[73520]: INFO os_vif [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=7af832cf-a4a6-4c84-8ca3-0b578347bbc0,network=Network(f69a4506-0d64-45bb-999c-cc0ac88b9830),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af832cf-a4')
Aug 16 12:20:56 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: df229b3d-196d-4764-b896-19c882d27d17] Instance destroyed successfully.
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lazy-loading 'resources' on Instance uuid df229b3d-196d-4764-b896-19c882d27d17 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-909796544',display_name='tempest-TestVolumeBootPattern-server-909796544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-909796544',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:19:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-w5seepkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:19:44Z,user_data=None,user_id='17ed1823b0de433ab523470e235fdd72',uuid=df229b3d-196d-4764-b896-19c882d27d17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "address": "fa:16:3e:64:7c:58", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ccfcb5-97", "ovs_interfaceid": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "address": "fa:16:3e:64:7c:58", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1ccfcb5-97", "ovs_interfaceid": "a1ccfcb5-97a3-4526-aabd-ade6796398f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:7c:58,bridge_name='br-int',has_traffic_filtering=True,id=a1ccfcb5-97a3-4526-aabd-ade6796398f3,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ccfcb5-97') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG os_vif [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:7c:58,bridge_name='br-int',has_traffic_filtering=True,id=a1ccfcb5-97a3-4526-aabd-ade6796398f3,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ccfcb5-97') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1ccfcb5-97, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] No BDM found with device name hda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] No VIF found with MAC fa:16:3e:a1:f5:32, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:20:56 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Using config drive
Aug 16 12:20:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:56 user nova-compute[73520]: INFO os_vif [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:7c:58,bridge_name='br-int',has_traffic_filtering=True,id=a1ccfcb5-97a3-4526-aabd-ade6796398f3,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1ccfcb5-97')
Aug 16 12:20:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzqMWoCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:20:56 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:20:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec99e74-9f20-40ec-98ab-f9b64f05b103]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c187392-f72b-4587-9b9a-44c7712a3fa7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:20:56 user nova-compute[73520]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a (non-flash)
Aug 16 12:20:56 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:20:56 user nova-compute[73520]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a (non-flash)
Aug 16 12:20:56 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c7d7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:20:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b21ed5-138b-4978-93c5-baf52a607613]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a32bef-3ee6-47ba-a716-f7554b6f6baa]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:20:57 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Creating config drive at /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk.config
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpagolek7g {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7464da-741d-4a84-940a-32d7650cfce3]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpagolek7g" returned: 0 in 0.065s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2b8df1-d55f-4ee5-b5dd-30dcde3d6f6c]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e14654db',) {{(pid=84372) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec3c9b1-8abc-442e-84c0-2ff1b6f1c73b]: (4, None) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e7492e-9602-4d11-9481-5c9c5a614583]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff07c44-75a1-47b8-b0b4-fb41832fe4f4]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a, portal: 172.16.0.220,3260]
Aug 16 12:20:57 user nova-compute[73520]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a, portal: 172.16.0.220,3260] successful.
Aug 16 12:20:57 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f2d46de-23e7-4659-96bb-d6cebb7fb72a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a87d993-ef97-480c-b404-a308c4334ebd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== disconnect_volume: return (353ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:20:57 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Deleting instance files /opt/stack/data/nova/instances/df229b3d-196d-4764-b896-19c882d27d17_del
Aug 16 12:20:57 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Deletion of /opt/stack/data/nova/instances/df229b3d-196d-4764-b896-19c882d27d17_del complete
Aug 16 12:20:57 user nova-compute[73520]: INFO nova.compute.manager [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: df229b3d-196d-4764-b896-19c882d27d17] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: df229b3d-196d-4764-b896-19c882d27d17] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG nova.network.neutron [req-fba5a15c-cd7d-4af2-b304-e742aaddba3f req-ae683770-b42c-46c7-b678-06dcad3412d9 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Updated VIF entry in instance network info cache for port 7af832cf-a4a6-4c84-8ca3-0b578347bbc0. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG nova.network.neutron [req-fba5a15c-cd7d-4af2-b304-e742aaddba3f req-ae683770-b42c-46c7-b678-06dcad3412d9 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Updating instance_info_cache with network_info: [{"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-fba5a15c-cd7d-4af2-b304-e742aaddba3f req-ae683770-b42c-46c7-b678-06dcad3412d9 service nova] Releasing lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:20:57 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: df229b3d-196d-4764-b896-19c882d27d17] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:20:58 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: df229b3d-196d-4764-b896-19c882d27d17] Took 0.66 seconds to deallocate network for instance.
Aug 16 12:20:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-2d25a3dd-19a2-47fc-86d6-15dbc77d743c req-648e5a7e-cb97-4505-abab-1b09537a6e85 service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Received event network-vif-deleted-a1ccfcb5-97a3-4526-aabd-ade6796398f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-c02be1c2-9bf6-4b0a-a264-e6d76b5aed9f req-60daa3a9-520d-4a15-a1f8-f3009aac8ccc service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Received event network-vif-unplugged-a1ccfcb5-97a3-4526-aabd-ade6796398f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c02be1c2-9bf6-4b0a-a264-e6d76b5aed9f req-60daa3a9-520d-4a15-a1f8-f3009aac8ccc service nova] Acquiring lock "df229b3d-196d-4764-b896-19c882d27d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c02be1c2-9bf6-4b0a-a264-e6d76b5aed9f req-60daa3a9-520d-4a15-a1f8-f3009aac8ccc service nova] Lock "df229b3d-196d-4764-b896-19c882d27d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c02be1c2-9bf6-4b0a-a264-e6d76b5aed9f req-60daa3a9-520d-4a15-a1f8-f3009aac8ccc service nova] Lock "df229b3d-196d-4764-b896-19c882d27d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-c02be1c2-9bf6-4b0a-a264-e6d76b5aed9f req-60daa3a9-520d-4a15-a1f8-f3009aac8ccc service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] No waiting events found dispatching network-vif-unplugged-a1ccfcb5-97a3-4526-aabd-ade6796398f3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-c02be1c2-9bf6-4b0a-a264-e6d76b5aed9f req-60daa3a9-520d-4a15-a1f8-f3009aac8ccc service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Received event network-vif-unplugged-a1ccfcb5-97a3-4526-aabd-ade6796398f3 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-c02be1c2-9bf6-4b0a-a264-e6d76b5aed9f req-60daa3a9-520d-4a15-a1f8-f3009aac8ccc service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Received event network-vif-plugged-a1ccfcb5-97a3-4526-aabd-ade6796398f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c02be1c2-9bf6-4b0a-a264-e6d76b5aed9f req-60daa3a9-520d-4a15-a1f8-f3009aac8ccc service nova] Acquiring lock "df229b3d-196d-4764-b896-19c882d27d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c02be1c2-9bf6-4b0a-a264-e6d76b5aed9f req-60daa3a9-520d-4a15-a1f8-f3009aac8ccc service nova] Lock "df229b3d-196d-4764-b896-19c882d27d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c02be1c2-9bf6-4b0a-a264-e6d76b5aed9f req-60daa3a9-520d-4a15-a1f8-f3009aac8ccc service nova] Lock "df229b3d-196d-4764-b896-19c882d27d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-c02be1c2-9bf6-4b0a-a264-e6d76b5aed9f req-60daa3a9-520d-4a15-a1f8-f3009aac8ccc service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] No waiting events found dispatching network-vif-plugged-a1ccfcb5-97a3-4526-aabd-ade6796398f3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:20:58 user nova-compute[73520]: WARNING nova.compute.manager [req-c02be1c2-9bf6-4b0a-a264-e6d76b5aed9f req-60daa3a9-520d-4a15-a1f8-f3009aac8ccc service nova] [instance: df229b3d-196d-4764-b896-19c882d27d17] Received unexpected event network-vif-plugged-a1ccfcb5-97a3-4526-aabd-ade6796398f3 for instance with vm_state active and task_state deleting.
Aug 16 12:20:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:20:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-131252e3-1ca6-4668-ae55-c0098b43018f req-2bb3c2d2-9f9b-4979-a46c-b2dc44654e58 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-131252e3-1ca6-4668-ae55-c0098b43018f req-2bb3c2d2-9f9b-4979-a46c-b2dc44654e58 service nova] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-131252e3-1ca6-4668-ae55-c0098b43018f req-2bb3c2d2-9f9b-4979-a46c-b2dc44654e58 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-131252e3-1ca6-4668-ae55-c0098b43018f req-2bb3c2d2-9f9b-4979-a46c-b2dc44654e58 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-131252e3-1ca6-4668-ae55-c0098b43018f req-2bb3c2d2-9f9b-4979-a46c-b2dc44654e58 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] No waiting events found dispatching network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:21:00 user nova-compute[73520]: WARNING nova.compute.manager [req-131252e3-1ca6-4668-ae55-c0098b43018f req-2bb3c2d2-9f9b-4979-a46c-b2dc44654e58 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received unexpected event network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 for instance with vm_state building and task_state spawning.
Aug 16 12:21:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-131252e3-1ca6-4668-ae55-c0098b43018f req-2bb3c2d2-9f9b-4979-a46c-b2dc44654e58 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-131252e3-1ca6-4668-ae55-c0098b43018f req-2bb3c2d2-9f9b-4979-a46c-b2dc44654e58 service nova] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-131252e3-1ca6-4668-ae55-c0098b43018f req-2bb3c2d2-9f9b-4979-a46c-b2dc44654e58 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-131252e3-1ca6-4668-ae55-c0098b43018f req-2bb3c2d2-9f9b-4979-a46c-b2dc44654e58 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-131252e3-1ca6-4668-ae55-c0098b43018f req-2bb3c2d2-9f9b-4979-a46c-b2dc44654e58 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] No waiting events found dispatching network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:21:00 user nova-compute[73520]: WARNING nova.compute.manager [req-131252e3-1ca6-4668-ae55-c0098b43018f req-2bb3c2d2-9f9b-4979-a46c-b2dc44654e58 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received unexpected event network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 for instance with vm_state building and task_state spawning.
Aug 16 12:21:00 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188460.991115, e3236316-dada-4aee-a210-6d9e9950c166 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:21:00 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e3236316-dada-4aee-a210-6d9e9950c166] VM Resumed (Lifecycle Event)
Aug 16 12:21:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:21:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:21:01 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Instance spawned successfully.
Aug 16 12:21:01 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:21:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:21:01 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:01 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:01 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:01 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:01 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:01 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:01 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e3236316-dada-4aee-a210-6d9e9950c166] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:21:01 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188460.9956775, e3236316-dada-4aee-a210-6d9e9950c166 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:21:01 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e3236316-dada-4aee-a210-6d9e9950c166] VM Started (Lifecycle Event)
Aug 16 12:21:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:21:01 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e3236316-dada-4aee-a210-6d9e9950c166] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:21:01 user nova-compute[73520]: INFO nova.compute.manager [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Took 6.96 seconds to spawn the instance on the hypervisor.
Aug 16 12:21:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:01 user nova-compute[73520]: INFO nova.compute.manager [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Took 7.67 seconds to build instance.
Aug 16 12:21:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dcb84cd2-9cc7-4eef-9d0d-d9e515a82aba tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "e3236316-dada-4aee-a210-6d9e9950c166" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.796s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:03 user nova-compute[73520]: INFO nova.compute.manager [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Took 5.37 seconds to detach 1 volumes for instance.
Aug 16 12:21:03 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: df229b3d-196d-4764-b896-19c882d27d17] Deleting volume: 3f2d46de-23e7-4659-96bb-d6cebb7fb72a {{(pid=73520) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 12:21:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:03 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:21:03 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:21:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:04 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Deleted allocations for instance df229b3d-196d-4764-b896-19c882d27d17
Aug 16 12:21:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d0c4ef6e-63b6-49ac-9607-72c133731e67 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "df229b3d-196d-4764-b896-19c882d27d17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.047s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:21:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:04 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:21:04 user nova-compute[73520]: INFO nova.compute.claims [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Claim successful on node user
Aug 16 12:21:04 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:21:04 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:21:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:21:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:21:04 user nova-compute[73520]: DEBUG nova.network.neutron [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:21:04 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:21:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG nova.policy [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a3c953350514bab80c857246568c427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f1f97356574bba85e0596dd1b6ed1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:21:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Creating image(s)
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "/opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "/opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.242s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.231s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk 1073741824" returned: 0 in 0.066s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.233s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:21:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:06 user nova-compute[73520]: DEBUG nova.network.neutron [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Successfully created port: 9477442a-ad39-46dd-8f9d-10063a9c2a10 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:21:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:06 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Cannot resize image /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:21:06 user nova-compute[73520]: DEBUG nova.objects.instance [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lazy-loading 'migration_context' on Instance uuid 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:21:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Ensure instance console log exists: /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:21:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Successfully updated port: 9477442a-ad39-46dd-8f9d-10063a9c2a10 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "refresh_cache-2e0f366b-6e25-44a3-91a8-5bcfa0a701bb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquired lock "refresh_cache-2e0f366b-6e25-44a3-91a8-5bcfa0a701bb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-382f2734-efb1-43f8-9a8f-ba195ab5f478 req-f5130b41-ef30-4ed6-8930-437314572495 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Received event network-changed-9477442a-ad39-46dd-8f9d-10063a9c2a10 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-382f2734-efb1-43f8-9a8f-ba195ab5f478 req-f5130b41-ef30-4ed6-8930-437314572495 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Refreshing instance network info cache due to event network-changed-9477442a-ad39-46dd-8f9d-10063a9c2a10. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-382f2734-efb1-43f8-9a8f-ba195ab5f478 req-f5130b41-ef30-4ed6-8930-437314572495 service nova] Acquiring lock "refresh_cache-2e0f366b-6e25-44a3-91a8-5bcfa0a701bb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Updating instance_info_cache with network_info: [{"id": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "address": "fa:16:3e:84:7f:07", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9477442a-ad", "ovs_interfaceid": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Releasing lock "refresh_cache-2e0f366b-6e25-44a3-91a8-5bcfa0a701bb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Instance network_info: |[{"id": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "address": "fa:16:3e:84:7f:07", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9477442a-ad", "ovs_interfaceid": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-382f2734-efb1-43f8-9a8f-ba195ab5f478 req-f5130b41-ef30-4ed6-8930-437314572495 service nova] Acquired lock "refresh_cache-2e0f366b-6e25-44a3-91a8-5bcfa0a701bb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.network.neutron [req-382f2734-efb1-43f8-9a8f-ba195ab5f478 req-f5130b41-ef30-4ed6-8930-437314572495 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Refreshing network info cache for port 9477442a-ad39-46dd-8f9d-10063a9c2a10 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Start _get_guest_xml network_info=[{"id": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "address": "fa:16:3e:84:7f:07", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9477442a-ad", "ovs_interfaceid": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:21:07 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:21:07 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-346692948',display_name='tempest-ServersNegativeTestJSON-server-346692948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-346692948',id=24,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95f1f97356574bba85e0596dd1b6ed1f',ramdisk_id='',reservation_id='r-3922ad8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1387585068',owner_user_name='tempest-ServersNegativeTestJSON-1387585068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:21:05Z,user_data=None,user_id='2a3c953350514bab80c857246568c427',uuid=2e0f366b-6e25-44a3-91a8-5bcfa0a701bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "address": "fa:16:3e:84:7f:07", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9477442a-ad", "ovs_interfaceid": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Converting VIF {"id": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "address": "fa:16:3e:84:7f:07", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9477442a-ad", "ovs_interfaceid": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=9477442a-ad39-46dd-8f9d-10063a9c2a10,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9477442a-ad') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.objects.instance [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:21:07 user nova-compute[73520]:   <uuid>2e0f366b-6e25-44a3-91a8-5bcfa0a701bb</uuid>
Aug 16 12:21:07 user nova-compute[73520]:   <name>instance-00000018</name>
Aug 16 12:21:07 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:21:07 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:21:07 user nova-compute[73520]:   <metadata>
Aug 16 12:21:07 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:21:07 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:21:07 user nova-compute[73520]:       <nova:name>tempest-ServersNegativeTestJSON-server-346692948</nova:name>
Aug 16 12:21:07 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:21:07</nova:creationTime>
Aug 16 12:21:07 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:21:07 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:21:07 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:21:07 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:21:07 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:21:07 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:21:07 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:21:07 user nova-compute[73520]:       <nova:owner>
Aug 16 12:21:07 user nova-compute[73520]:         <nova:user uuid="2a3c953350514bab80c857246568c427">tempest-ServersNegativeTestJSON-1387585068-project-member</nova:user>
Aug 16 12:21:07 user nova-compute[73520]:         <nova:project uuid="95f1f97356574bba85e0596dd1b6ed1f">tempest-ServersNegativeTestJSON-1387585068</nova:project>
Aug 16 12:21:07 user nova-compute[73520]:       </nova:owner>
Aug 16 12:21:07 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:21:07 user nova-compute[73520]:       <nova:ports>
Aug 16 12:21:07 user nova-compute[73520]:         <nova:port uuid="9477442a-ad39-46dd-8f9d-10063a9c2a10">
Aug 16 12:21:07 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 12:21:07 user nova-compute[73520]:         </nova:port>
Aug 16 12:21:07 user nova-compute[73520]:       </nova:ports>
Aug 16 12:21:07 user nova-compute[73520]:     </nova:instance>
Aug 16 12:21:07 user nova-compute[73520]:   </metadata>
Aug 16 12:21:07 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:21:07 user nova-compute[73520]:     <system>
Aug 16 12:21:07 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:21:07 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:21:07 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:21:07 user nova-compute[73520]:       <entry name="serial">2e0f366b-6e25-44a3-91a8-5bcfa0a701bb</entry>
Aug 16 12:21:07 user nova-compute[73520]:       <entry name="uuid">2e0f366b-6e25-44a3-91a8-5bcfa0a701bb</entry>
Aug 16 12:21:07 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:21:07 user nova-compute[73520]:     </system>
Aug 16 12:21:07 user nova-compute[73520]:   </sysinfo>
Aug 16 12:21:07 user nova-compute[73520]:   <os>
Aug 16 12:21:07 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:21:07 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:21:07 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:21:07 user nova-compute[73520]:   </os>
Aug 16 12:21:07 user nova-compute[73520]:   <features>
Aug 16 12:21:07 user nova-compute[73520]:     <acpi/>
Aug 16 12:21:07 user nova-compute[73520]:     <apic/>
Aug 16 12:21:07 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:21:07 user nova-compute[73520]:   </features>
Aug 16 12:21:07 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:21:07 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:21:07 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:21:07 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:21:07 user nova-compute[73520]:   </clock>
Aug 16 12:21:07 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:21:07 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:21:07 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:21:07 user nova-compute[73520]:   </cpu>
Aug 16 12:21:07 user nova-compute[73520]:   <devices>
Aug 16 12:21:07 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:21:07 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:21:07 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk"/>
Aug 16 12:21:07 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:21:07 user nova-compute[73520]:     </disk>
Aug 16 12:21:07 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:21:07 user nova-compute[73520]:       <mac address="fa:16:3e:84:7f:07"/>
Aug 16 12:21:07 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:21:07 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:21:07 user nova-compute[73520]:       <target dev="tap9477442a-ad"/>
Aug 16 12:21:07 user nova-compute[73520]:     </interface>
Aug 16 12:21:07 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:21:07 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/console.log" append="off"/>
Aug 16 12:21:07 user nova-compute[73520]:     </serial>
Aug 16 12:21:07 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:21:07 user nova-compute[73520]:     <video>
Aug 16 12:21:07 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:21:07 user nova-compute[73520]:     </video>
Aug 16 12:21:07 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:21:07 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:21:07 user nova-compute[73520]:     </rng>
Aug 16 12:21:07 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:21:07 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:21:07 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:21:07 user nova-compute[73520]:     </memballoon>
Aug 16 12:21:07 user nova-compute[73520]:   </devices>
Aug 16 12:21:07 user nova-compute[73520]: </domain>
Aug 16 12:21:07 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-346692948',display_name='tempest-ServersNegativeTestJSON-server-346692948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-346692948',id=24,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95f1f97356574bba85e0596dd1b6ed1f',ramdisk_id='',reservation_id='r-3922ad8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1387585068',owner_user_name='tempest-ServersNegativeTestJSON-1387585068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:21:05Z,user_data=None,user_id='2a3c953350514bab80c857246568c427',uuid=2e0f366b-6e25-44a3-91a8-5bcfa0a701bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "address": "fa:16:3e:84:7f:07", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9477442a-ad", "ovs_interfaceid": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Converting VIF {"id": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "address": "fa:16:3e:84:7f:07", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9477442a-ad", "ovs_interfaceid": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=9477442a-ad39-46dd-8f9d-10063a9c2a10,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9477442a-ad') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG os_vif [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=9477442a-ad39-46dd-8f9d-10063a9c2a10,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9477442a-ad') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9477442a-ad, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9477442a-ad, col_values=(('external_ids', {'iface-id': '9477442a-ad39-46dd-8f9d-10063a9c2a10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:7f:07', 'vm-uuid': '2e0f366b-6e25-44a3-91a8-5bcfa0a701bb'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:07 user nova-compute[73520]: INFO os_vif [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=9477442a-ad39-46dd-8f9d-10063a9c2a10,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9477442a-ad')
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:21:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] No VIF found with MAC fa:16:3e:84:7f:07, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:21:08 user nova-compute[73520]: DEBUG nova.network.neutron [req-382f2734-efb1-43f8-9a8f-ba195ab5f478 req-f5130b41-ef30-4ed6-8930-437314572495 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Updated VIF entry in instance network info cache for port 9477442a-ad39-46dd-8f9d-10063a9c2a10. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:21:08 user nova-compute[73520]: DEBUG nova.network.neutron [req-382f2734-efb1-43f8-9a8f-ba195ab5f478 req-f5130b41-ef30-4ed6-8930-437314572495 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Updating instance_info_cache with network_info: [{"id": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "address": "fa:16:3e:84:7f:07", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9477442a-ad", "ovs_interfaceid": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-382f2734-efb1-43f8-9a8f-ba195ab5f478 req-f5130b41-ef30-4ed6-8930-437314572495 service nova] Releasing lock "refresh_cache-2e0f366b-6e25-44a3-91a8-5bcfa0a701bb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:21:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-e07f4809-2908-43ee-8bc4-e3aef5dce38b req-fcfcc6ff-06e7-4713-b328-e8f084459728 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Received event network-vif-plugged-9477442a-ad39-46dd-8f9d-10063a9c2a10 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e07f4809-2908-43ee-8bc4-e3aef5dce38b req-fcfcc6ff-06e7-4713-b328-e8f084459728 service nova] Acquiring lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e07f4809-2908-43ee-8bc4-e3aef5dce38b req-fcfcc6ff-06e7-4713-b328-e8f084459728 service nova] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e07f4809-2908-43ee-8bc4-e3aef5dce38b req-fcfcc6ff-06e7-4713-b328-e8f084459728 service nova] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-e07f4809-2908-43ee-8bc4-e3aef5dce38b req-fcfcc6ff-06e7-4713-b328-e8f084459728 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] No waiting events found dispatching network-vif-plugged-9477442a-ad39-46dd-8f9d-10063a9c2a10 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:21:09 user nova-compute[73520]: WARNING nova.compute.manager [req-e07f4809-2908-43ee-8bc4-e3aef5dce38b req-fcfcc6ff-06e7-4713-b328-e8f084459728 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Received unexpected event network-vif-plugged-9477442a-ad39-46dd-8f9d-10063a9c2a10 for instance with vm_state building and task_state spawning.
Aug 16 12:21:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188471.3277936, 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:21:11 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] VM Resumed (Lifecycle Event)
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:21:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Instance spawned successfully.
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:11 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188471.3297367, 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:21:11 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] VM Started (Lifecycle Event)
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:21:11 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:21:11 user nova-compute[73520]: INFO nova.compute.manager [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:11 user nova-compute[73520]: INFO nova.compute.manager [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Took 7.23 seconds to build instance.
Aug 16 12:21:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-da93787e-6307-444c-99be-5eb9d94b7b29 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.375s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188456.8451838, df229b3d-196d-4764-b896-19c882d27d17 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:21:11 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: df229b3d-196d-4764-b896-19c882d27d17] VM Stopped (Lifecycle Event)
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2f368f06-0684-4803-8976-8c0a232850cd None None] [instance: df229b3d-196d-4764-b896-19c882d27d17] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-4c74d692-332f-481f-9d5c-da267e02eebb req-707eb41e-f5da-49cd-ae46-dfaa01160d07 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Received event network-vif-plugged-9477442a-ad39-46dd-8f9d-10063a9c2a10 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4c74d692-332f-481f-9d5c-da267e02eebb req-707eb41e-f5da-49cd-ae46-dfaa01160d07 service nova] Acquiring lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4c74d692-332f-481f-9d5c-da267e02eebb req-707eb41e-f5da-49cd-ae46-dfaa01160d07 service nova] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4c74d692-332f-481f-9d5c-da267e02eebb req-707eb41e-f5da-49cd-ae46-dfaa01160d07 service nova] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-4c74d692-332f-481f-9d5c-da267e02eebb req-707eb41e-f5da-49cd-ae46-dfaa01160d07 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] No waiting events found dispatching network-vif-plugged-9477442a-ad39-46dd-8f9d-10063a9c2a10 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:21:11 user nova-compute[73520]: WARNING nova.compute.manager [req-4c74d692-332f-481f-9d5c-da267e02eebb req-707eb41e-f5da-49cd-ae46-dfaa01160d07 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Received unexpected event network-vif-plugged-9477442a-ad39-46dd-8f9d-10063a9c2a10 for instance with vm_state active and task_state None.
Aug 16 12:21:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "4aec6c13-9121-4c61-9844-d28d420fde09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "4aec6c13-9121-4c61-9844-d28d420fde09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:13 user nova-compute[73520]: INFO nova.compute.manager [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Terminating instance
Aug 16 12:21:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:21:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:13 user nova-compute[73520]: INFO nova.compute.manager [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Unshelving
Aug 16 12:21:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:14 user nova-compute[73520]: INFO nova.virt.block_device [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Booting with volume 6f93eb09-4320-4998-b6b3-2e0568019c81 at /dev/vdc
Aug 16 12:21:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-e9933410-c62b-4646-accd-a3eb4e463b40 req-bf285978-4ff8-4a2f-98e3-5fed47ba2b40 service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Received event network-vif-unplugged-37d3de01-eaaf-4b05-b262-2a5359a07310 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e9933410-c62b-4646-accd-a3eb4e463b40 req-bf285978-4ff8-4a2f-98e3-5fed47ba2b40 service nova] Acquiring lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e9933410-c62b-4646-accd-a3eb4e463b40 req-bf285978-4ff8-4a2f-98e3-5fed47ba2b40 service nova] Lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e9933410-c62b-4646-accd-a3eb4e463b40 req-bf285978-4ff8-4a2f-98e3-5fed47ba2b40 service nova] Lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-e9933410-c62b-4646-accd-a3eb4e463b40 req-bf285978-4ff8-4a2f-98e3-5fed47ba2b40 service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] No waiting events found dispatching network-vif-unplugged-37d3de01-eaaf-4b05-b262-2a5359a07310 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-e9933410-c62b-4646-accd-a3eb4e463b40 req-bf285978-4ff8-4a2f-98e3-5fed47ba2b40 service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Received event network-vif-unplugged-37d3de01-eaaf-4b05-b262-2a5359a07310 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG os_brick.utils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42f8ea7-5c8c-4e70-969b-d38fca0c567c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4b377e-b527-4797-8fa2-6752d8eff492]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[05304447-b7bf-4fda-8194-f0437efabe44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3f2760-978d-4da4-91a6-c4e362e9ccdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:21:14 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f8ac17-e1b9-4f79-8ccf-5bb2bd456244]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG os_brick.utils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updating existing volume attachment record: 21d15f29-cf05-4475-8d93-106be152d2e0 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:21:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Instance destroyed successfully.
Aug 16 12:21:14 user nova-compute[73520]: DEBUG nova.objects.instance [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lazy-loading 'resources' on Instance uuid 4aec6c13-9121-4c61-9844-d28d420fde09 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-125156199',display_name='tempest-VolumesActionsTest-instance-125156199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-125156199',id=20,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa2639b61de64add87f6510f520aa158',ramdisk_id='',reservation_id='r-0bsmn55c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-623859009',owner_user_name='tempest-VolumesActionsTest-623859009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:19:32Z,user_data=None,user_id='223a4316eda946d38dd77143a4847484',uuid=4aec6c13-9121-4c61-9844-d28d420fde09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37d3de01-eaaf-4b05-b262-2a5359a07310", "address": "fa:16:3e:7a:e6:f8", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d3de01-ea", "ovs_interfaceid": "37d3de01-eaaf-4b05-b262-2a5359a07310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Converting VIF {"id": "37d3de01-eaaf-4b05-b262-2a5359a07310", "address": "fa:16:3e:7a:e6:f8", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d3de01-ea", "ovs_interfaceid": "37d3de01-eaaf-4b05-b262-2a5359a07310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e6:f8,bridge_name='br-int',has_traffic_filtering=True,id=37d3de01-eaaf-4b05-b262-2a5359a07310,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d3de01-ea') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG os_vif [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e6:f8,bridge_name='br-int',has_traffic_filtering=True,id=37d3de01-eaaf-4b05-b262-2a5359a07310,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d3de01-ea') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37d3de01-ea, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:21:14 user nova-compute[73520]: INFO os_vif [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e6:f8,bridge_name='br-int',has_traffic_filtering=True,id=37d3de01-eaaf-4b05-b262-2a5359a07310,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d3de01-ea')
Aug 16 12:21:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Deleting instance files /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09_del
Aug 16 12:21:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Deletion of /opt/stack/data/nova/instances/4aec6c13-9121-4c61-9844-d28d420fde09_del complete
Aug 16 12:21:14 user nova-compute[73520]: INFO nova.compute.manager [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 12:21:14 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:21:14 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:21:15 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:15 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Took 0.57 seconds to deallocate network for instance.
Aug 16 12:21:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-df932004-0574-46dc-bbf6-1872b3a711f1 req-547c9a0a-3fb6-4452-9252-ee2ac78a18e8 service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Received event network-vif-deleted-37d3de01-eaaf-4b05-b262-2a5359a07310 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:15 user nova-compute[73520]: INFO nova.compute.manager [req-df932004-0574-46dc-bbf6-1872b3a711f1 req-547c9a0a-3fb6-4452-9252-ee2ac78a18e8 service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Neutron deleted interface 37d3de01-eaaf-4b05-b262-2a5359a07310; detaching it from the instance and deleting it from the info cache
Aug 16 12:21:15 user nova-compute[73520]: DEBUG nova.network.neutron [req-df932004-0574-46dc-bbf6-1872b3a711f1 req-547c9a0a-3fb6-4452-9252-ee2ac78a18e8 service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-df932004-0574-46dc-bbf6-1872b3a711f1 req-547c9a0a-3fb6-4452-9252-ee2ac78a18e8 service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Detach interface failed, port_id=37d3de01-eaaf-4b05-b262-2a5359a07310, reason: Instance 4aec6c13-9121-4c61-9844-d28d420fde09 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:21:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:15 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:21:15 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:21:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.581s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:15 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Deleted allocations for instance 4aec6c13-9121-4c61-9844-d28d420fde09
Aug 16 12:21:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e85b4412-77a8-4818-a1d3-e8a9cd2b787d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "4aec6c13-9121-4c61-9844-d28d420fde09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.346s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-a379b94b-83a7-4652-a887-90260399e789 req-987be3a5-cffd-4a9e-acff-13b45d5e6e29 service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Received event network-vif-plugged-37d3de01-eaaf-4b05-b262-2a5359a07310 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a379b94b-83a7-4652-a887-90260399e789 req-987be3a5-cffd-4a9e-acff-13b45d5e6e29 service nova] Acquiring lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a379b94b-83a7-4652-a887-90260399e789 req-987be3a5-cffd-4a9e-acff-13b45d5e6e29 service nova] Lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a379b94b-83a7-4652-a887-90260399e789 req-987be3a5-cffd-4a9e-acff-13b45d5e6e29 service nova] Lock "4aec6c13-9121-4c61-9844-d28d420fde09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-a379b94b-83a7-4652-a887-90260399e789 req-987be3a5-cffd-4a9e-acff-13b45d5e6e29 service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] No waiting events found dispatching network-vif-plugged-37d3de01-eaaf-4b05-b262-2a5359a07310 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:21:16 user nova-compute[73520]: WARNING nova.compute.manager [req-a379b94b-83a7-4652-a887-90260399e789 req-987be3a5-cffd-4a9e-acff-13b45d5e6e29 service nova] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Received unexpected event network-vif-plugged-37d3de01-eaaf-4b05-b262-2a5359a07310 for instance with vm_state deleted and task_state None.
Aug 16 12:21:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:23 user nova-compute[73520]: DEBUG nova.compute.manager [req-e753189f-c625-4c36-9b8c-64edcf71f288 req-78762ac4-ee94-4839-91a6-a6034a8a6ec5 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Received event network-changed-fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:23 user nova-compute[73520]: DEBUG nova.compute.manager [req-e753189f-c625-4c36-9b8c-64edcf71f288 req-78762ac4-ee94-4839-91a6-a6034a8a6ec5 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Refreshing instance network info cache due to event network-changed-fa463141-b9cd-48a7-98ec-d36b007f4f5b. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:21:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e753189f-c625-4c36-9b8c-64edcf71f288 req-78762ac4-ee94-4839-91a6-a6034a8a6ec5 service nova] Acquiring lock "refresh_cache-70eeda03-767e-4c60-b535-9b250b63513b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:21:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e753189f-c625-4c36-9b8c-64edcf71f288 req-78762ac4-ee94-4839-91a6-a6034a8a6ec5 service nova] Acquired lock "refresh_cache-70eeda03-767e-4c60-b535-9b250b63513b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:21:23 user nova-compute[73520]: DEBUG nova.network.neutron [req-e753189f-c625-4c36-9b8c-64edcf71f288 req-78762ac4-ee94-4839-91a6-a6034a8a6ec5 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Refreshing network info cache for port fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:21:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:23 user nova-compute[73520]: DEBUG nova.network.neutron [req-e753189f-c625-4c36-9b8c-64edcf71f288 req-78762ac4-ee94-4839-91a6-a6034a8a6ec5 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Updated VIF entry in instance network info cache for port fa463141-b9cd-48a7-98ec-d36b007f4f5b. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:21:23 user nova-compute[73520]: DEBUG nova.network.neutron [req-e753189f-c625-4c36-9b8c-64edcf71f288 req-78762ac4-ee94-4839-91a6-a6034a8a6ec5 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Updating instance_info_cache with network_info: [{"id": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "address": "fa:16:3e:3c:be:f7", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa463141-b9", "ovs_interfaceid": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e753189f-c625-4c36-9b8c-64edcf71f288 req-78762ac4-ee94-4839-91a6-a6034a8a6ec5 service nova] Releasing lock "refresh_cache-70eeda03-767e-4c60-b535-9b250b63513b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:21:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:25 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'pci_requests' on Instance uuid b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:25 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'numa_topology' on Instance uuid b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:21:25 user nova-compute[73520]: INFO nova.compute.claims [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Claim successful on node user
Aug 16 12:21:25 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:21:25 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:21:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:26 user nova-compute[73520]: INFO nova.network.neutron [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updating port f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquired lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG nova.network.neutron [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-c32b347d-19da-4fa6-a920-6b8799a0adfc req-984d7d41-c7a3-4afd-8d21-8d8529bfe90c service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-changed-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-c32b347d-19da-4fa6-a920-6b8799a0adfc req-984d7d41-c7a3-4afd-8d21-8d8529bfe90c service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Refreshing instance network info cache due to event network-changed-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c32b347d-19da-4fa6-a920-6b8799a0adfc req-984d7d41-c7a3-4afd-8d21-8d8529bfe90c service nova] Acquiring lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG nova.network.neutron [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updating instance_info_cache with network_info: [{"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Releasing lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:21:27 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Creating image(s)
Aug 16 12:21:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "/opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "/opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "/opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'trusted_certs' on Instance uuid b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c32b347d-19da-4fa6-a920-6b8799a0adfc req-984d7d41-c7a3-4afd-8d21-8d8529bfe90c service nova] Acquired lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG nova.network.neutron [req-c32b347d-19da-4fa6-a920-6b8799a0adfc req-984d7d41-c7a3-4afd-8d21-8d8529bfe90c service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Refreshing network info cache for port f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "cb71fde6d83d95a62113ee4636eec78a120c85a1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "cb71fde6d83d95a62113ee4636eec78a120c85a1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1.part --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1.part --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:28 user nova-compute[73520]: DEBUG nova.virt.images [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] 4cec05f3-a47c-4916-bb04-e55d6ba10b5a was qcow2, converting to raw {{(pid=73520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 12:21:28 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:21:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1.part /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1.converted {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:29 user nova-compute[73520]: INFO nova.compute.manager [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Detaching volume 41f191e0-c282-4ab3-ba32-c95c68d30992
Aug 16 12:21:29 user nova-compute[73520]: INFO nova.virt.block_device [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Attempting to driver detach volume 41f191e0-c282-4ab3-ba32-c95c68d30992 from mountpoint /dev/vdb
Aug 16 12:21:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Attempting to detach device vdb from instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:21:29 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:21:29 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:21:29 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:21:29 user nova-compute[73520]:   <serial>41f191e0-c282-4ab3-ba32-c95c68d30992</serial>
Aug 16 12:21:29 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 12:21:29 user nova-compute[73520]: </disk>
Aug 16 12:21:29 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:21:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Successfully detached device vdb from instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be from the persistent domain config.
Aug 16 12:21:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:21:29 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:21:29 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:21:29 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:21:29 user nova-compute[73520]:   <serial>41f191e0-c282-4ab3-ba32-c95c68d30992</serial>
Aug 16 12:21:29 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 12:21:29 user nova-compute[73520]: </disk>
Aug 16 12:21:29 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1.part /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1.converted" returned: 0 in 0.427s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1.converted --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "70eeda03-767e-4c60-b535-9b250b63513b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "70eeda03-767e-4c60-b535-9b250b63513b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'flavor' on Instance uuid 70eeda03-767e-4c60-b535-9b250b63513b {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1.converted --force-share --output=json" returned: 0 in 0.257s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "cb71fde6d83d95a62113ee4636eec78a120c85a1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.876s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188474.4734287, 4aec6c13-9121-4c61-9844-d28d420fde09 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:21:29 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] VM Stopped (Lifecycle Event)
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "70eeda03-767e-4c60-b535-9b250b63513b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.211s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG nova.network.neutron [req-c32b347d-19da-4fa6-a920-6b8799a0adfc req-984d7d41-c7a3-4afd-8d21-8d8529bfe90c service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updated VIF entry in instance network info cache for port f9fc71dc-3ee9-497a-a60e-e39046c2d9f3. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG nova.network.neutron [req-c32b347d-19da-4fa6-a920-6b8799a0adfc req-984d7d41-c7a3-4afd-8d21-8d8529bfe90c service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updating instance_info_cache with network_info: [{"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4f67daee-456f-48e4-834e-90607dfb10a8 None None] [instance: 4aec6c13-9121-4c61-9844-d28d420fde09] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c32b347d-19da-4fa6-a920-6b8799a0adfc req-984d7d41-c7a3-4afd-8d21-8d8529bfe90c service nova] Releasing lock "refresh_cache-b58731e0-399d-4f8d-84b8-af12a46cf87f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1 --force-share --output=json" returned: 0 in 0.209s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "cb71fde6d83d95a62113ee4636eec78a120c85a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "cb71fde6d83d95a62113ee4636eec78a120c85a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188489.721959, 5bc17e5d-3ae1-474d-bd49-71c60f3e46be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:21:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Successfully detached device vdb from instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be from the live domain config.
Aug 16 12:21:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGcmdoMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:21:29 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:21:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa2e05a-e22d-433c-be79-4ba2ad223058]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "70eeda03-767e-4c60-b535-9b250b63513b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "70eeda03-767e-4c60-b535-9b250b63513b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:29 user nova-compute[73520]: INFO nova.compute.manager [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Attaching volume 3a8077f6-24b9-43c4-a30a-4d1ff808159c to /dev/vdb
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[229237a4-36de-4400-afde-147fad9dcf3d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:21:29 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 (non-flash)
Aug 16 12:21:29 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c771fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992'): ({'sdc'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Removing single pathed devices sdc {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1 --force-share --output=json" returned: 0 in 0.204s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1,backing_fmt=raw /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2795ea09-99f3-4a0d-b2db-74c601bfcb5b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG os_brick.utils [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1,backing_fmt=raw /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk 1073741824" returned: 0 in 0.063s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "cb71fde6d83d95a62113ee4636eec78a120c85a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e40973a-62fc-467e-a56a-9feb90b1c69a]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1d9e3f-6175-46bf-854a-f8b4878deac0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flushing IO for device /dev/sdc {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9fc2e8-992c-4caf-b78b-3aa197f6a401]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eca3574-cc97-45f5-8539-6e752d7ac844]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14d5d95-43dd-4811-ae8e-d2fdaa4f2011]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01ffe51-1560-43af-a148-ec2e46ed4f3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afcf05c-f0ac-4282-b175-478f90694979]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:21:30 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d89934f-0702-43a9-9d22-6635d128e969]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG os_brick.utils [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Updating existing volume attachment record: df4bf396-4789-4273-b411-e6a45f329458 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[046571a7-06b4-4f4f-aa6f-22b8b80ad794]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1 --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'migration_context' on Instance uuid b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:30 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Rebasing disk image.
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ddee3a-c920-466a-8489-6c462e38d63d]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260]
Aug 16 12:21:30 user nova-compute[73520]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992, portal: 172.16.0.220,3260] successful.
Aug 16 12:21:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f191e0-c282-4ab3-ba32-c95c68d30992 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[505b8cb2-bb4e-4d3e-92ab-9ebd94785761]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] <== disconnect_volume: return (431ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.196s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 -F raw /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:21:30 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:21:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 -F raw /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk" returned: 0 in 2.394s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Ensure instance console log exists: /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Start _get_guest_xml network_info=[{"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='07d3429265cfdf624cbe76858cf70d21',container_format='bare',created_at=2023-08-16T12:19:21Z,direct_url=<?>,disk_format='qcow2',id=4cec05f3-a47c-4916-bb04-e55d6ba10b5a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-466509847-shelved',owner='ed29e455a840474b8a1407af538883ab',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T12:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MSJNDkyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'b58731e0-399d-4f8d-84b8-af12a46cf87f', 'attached_at': '', 'detached_at': '', 'volume_id': '6f93eb09-4320-4998-b6b3-2e0568019c81', 'serial': '6f93eb09-4320-4998-b6b3-2e0568019c81'}, 'attachment_id': '21d15f29-cf05-4475-8d93-106be152d2e0', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:21:32 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:21:32 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='07d3429265cfdf624cbe76858cf70d21',container_format='bare',created_at=2023-08-16T12:19:21Z,direct_url=<?>,disk_format='qcow2',id=4cec05f3-a47c-4916-bb04-e55d6ba10b5a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-466509847-shelved',owner='ed29e455a840474b8a1407af538883ab',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T12:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'vcpu_model' on Instance uuid b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MSJNDkyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:21:32 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:21:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:21:32 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:21:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.074s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:21:32 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:21:32 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:21:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[14451f24-d7e1-424c-ba6a-4b865568c74d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:21:33 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2728865c-7d54-4073-afe2-896475ae2adb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81] added
Aug 16 12:21:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe3287d-9e81-44a1-b6fa-18977aabe704]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1cf6e9-b28a-4ec0-985b-21567dd617e2]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MSJNDkyi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MSJNDkyi" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c501e32-6fed-4f23-ada5-e896d2a5181b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MSJNDkyi'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bb861e-bee8-4f1e-9560-e0c77db3ba02]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56b3749-b449-4e0a-a9c0-cc965de2fb57]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:21:33 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:21:33 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:21:33 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 12:21:33 user nova-compute[73520]: 
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e166ce22-53b4-48ac-ad7c-9020a34ba819]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81, portal: 172.16.0.220,3260]
Aug 16 12:21:33 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81, portal: 172.16.0.220,3260] successful.
Aug 16 12:21:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49d8a14-210a-4df2-b1aa-c10ba8741589]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab18f59e-49f7-4fb3-b96f-c9f6559b9858]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:21:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:21:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4a5266-6d17-4a0e-aab5-fad46b7554f8]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MSJNDkyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:21:33 user nova-compute[73520]: INFO nova.compute.claims [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Claim successful on node user
Aug 16 12:21:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "4926037c-8e89-4923-940f-9837b053b9a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "4926037c-8e89-4923-940f-9837b053b9a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG nova.network.neutron [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:33 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:21:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:21:33 user nova-compute[73520]: INFO nova.compute.claims [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Claim successful on node user
Aug 16 12:21:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.policy [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d351d0adad3463ebb2e6917a5f91920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930fb7964e2942c88c3416be172c6884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:21:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Creating image(s)
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "/opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "/opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23039383566636538', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039383566636538', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-466509847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-466509847',id=16,image_ref='4cec05f3-a47c-4916-bb04-e55d6ba10b5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-536458928',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ed29e455a840474b8a1407af538883ab',ramdisk_id='',reservation_id='r-ivvsky98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-974908846',owner_user_name='tempest-AttachVolumeShelveTestJSON-974908846-project-member',shelved_at='2023-08-16T12:19:26.215805',shelved_host='user',shelved_image_id='4cec05f3-a47c-4916-bb04-e55d6ba10b5a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7e48ee408e24af083b40b19437cfbac',uuid=b58731e0-399d-4f8d-84b8-af12a46cf87f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converting VIF {"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'pci_devices' on Instance uuid b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:21:34 user nova-compute[73520]:   <uuid>b58731e0-399d-4f8d-84b8-af12a46cf87f</uuid>
Aug 16 12:21:34 user nova-compute[73520]:   <name>instance-00000010</name>
Aug 16 12:21:34 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:21:34 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:21:34 user nova-compute[73520]:   <metadata>
Aug 16 12:21:34 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:21:34 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:21:34 user nova-compute[73520]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-466509847</nova:name>
Aug 16 12:21:34 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:21:32</nova:creationTime>
Aug 16 12:21:34 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:21:34 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:21:34 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:21:34 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:21:34 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:21:34 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:21:34 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:21:34 user nova-compute[73520]:       <nova:owner>
Aug 16 12:21:34 user nova-compute[73520]:         <nova:user uuid="b7e48ee408e24af083b40b19437cfbac">tempest-AttachVolumeShelveTestJSON-974908846-project-member</nova:user>
Aug 16 12:21:34 user nova-compute[73520]:         <nova:project uuid="ed29e455a840474b8a1407af538883ab">tempest-AttachVolumeShelveTestJSON-974908846</nova:project>
Aug 16 12:21:34 user nova-compute[73520]:       </nova:owner>
Aug 16 12:21:34 user nova-compute[73520]:       <nova:root type="image" uuid="4cec05f3-a47c-4916-bb04-e55d6ba10b5a"/>
Aug 16 12:21:34 user nova-compute[73520]:       <nova:ports>
Aug 16 12:21:34 user nova-compute[73520]:         <nova:port uuid="f9fc71dc-3ee9-497a-a60e-e39046c2d9f3">
Aug 16 12:21:34 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 12:21:34 user nova-compute[73520]:         </nova:port>
Aug 16 12:21:34 user nova-compute[73520]:       </nova:ports>
Aug 16 12:21:34 user nova-compute[73520]:     </nova:instance>
Aug 16 12:21:34 user nova-compute[73520]:   </metadata>
Aug 16 12:21:34 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:21:34 user nova-compute[73520]:     <system>
Aug 16 12:21:34 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:21:34 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:21:34 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:21:34 user nova-compute[73520]:       <entry name="serial">b58731e0-399d-4f8d-84b8-af12a46cf87f</entry>
Aug 16 12:21:34 user nova-compute[73520]:       <entry name="uuid">b58731e0-399d-4f8d-84b8-af12a46cf87f</entry>
Aug 16 12:21:34 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:21:34 user nova-compute[73520]:     </system>
Aug 16 12:21:34 user nova-compute[73520]:   </sysinfo>
Aug 16 12:21:34 user nova-compute[73520]:   <os>
Aug 16 12:21:34 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:21:34 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:21:34 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:21:34 user nova-compute[73520]:   </os>
Aug 16 12:21:34 user nova-compute[73520]:   <features>
Aug 16 12:21:34 user nova-compute[73520]:     <acpi/>
Aug 16 12:21:34 user nova-compute[73520]:     <apic/>
Aug 16 12:21:34 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:21:34 user nova-compute[73520]:   </features>
Aug 16 12:21:34 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:21:34 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:21:34 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:21:34 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:21:34 user nova-compute[73520]:   </clock>
Aug 16 12:21:34 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:21:34 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:21:34 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:21:34 user nova-compute[73520]:   </cpu>
Aug 16 12:21:34 user nova-compute[73520]:   <devices>
Aug 16 12:21:34 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:21:34 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:21:34 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk"/>
Aug 16 12:21:34 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:21:34 user nova-compute[73520]:     </disk>
Aug 16 12:21:34 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:21:34 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:21:34 user nova-compute[73520]:       <source dev="/dev/sdb"/>
Aug 16 12:21:34 user nova-compute[73520]:       <target dev="vdc" bus="virtio"/>
Aug 16 12:21:34 user nova-compute[73520]:       <serial>6f93eb09-4320-4998-b6b3-2e0568019c81</serial>
Aug 16 12:21:34 user nova-compute[73520]:     </disk>
Aug 16 12:21:34 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:21:34 user nova-compute[73520]:       <mac address="fa:16:3e:e6:e2:11"/>
Aug 16 12:21:34 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:21:34 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:21:34 user nova-compute[73520]:       <target dev="tapf9fc71dc-3e"/>
Aug 16 12:21:34 user nova-compute[73520]:     </interface>
Aug 16 12:21:34 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:21:34 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/console.log" append="off"/>
Aug 16 12:21:34 user nova-compute[73520]:     </serial>
Aug 16 12:21:34 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:21:34 user nova-compute[73520]:     <video>
Aug 16 12:21:34 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:21:34 user nova-compute[73520]:     </video>
Aug 16 12:21:34 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:21:34 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:21:34 user nova-compute[73520]:     </rng>
Aug 16 12:21:34 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:21:34 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:21:34 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:21:34 user nova-compute[73520]:     </memballoon>
Aug 16 12:21:34 user nova-compute[73520]:   </devices>
Aug 16 12:21:34 user nova-compute[73520]: </domain>
Aug 16 12:21:34 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-466509847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-466509847',id=16,image_ref='4cec05f3-a47c-4916-bb04-e55d6ba10b5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-536458928',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ed29e455a840474b8a1407af538883ab',ramdisk_id='',reservation_id='r-ivvsky98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-974908846',owner_user_name='tempest-AttachVolumeShelveTestJSON-974908846-project-member',shelved_at='2023-08-16T12:19:26.215805',shelved_host='user',shelved_image_id='4cec05f3-a47c-4916-bb04-e55d6ba10b5a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7e48ee408e24af083b40b19437cfbac',uuid=b58731e0-399d-4f8d-84b8-af12a46cf87f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converting VIF {"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG os_vif [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9fc71dc-3e, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9fc71dc-3e, col_values=(('external_ids', {'iface-id': 'f9fc71dc-3ee9-497a-a60e-e39046c2d9f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:e2:11', 'vm-uuid': 'b58731e0-399d-4f8d-84b8-af12a46cf87f'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:34 user nova-compute[73520]: INFO os_vif [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e')
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.321s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.202s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.739s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk 1073741824" returned: 0 in 0.062s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] No VIF found with MAC fa:16:3e:e6:e2:11, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:21:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.209s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:21:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG nova.policy [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d351d0adad3463ebb2e6917a5f91920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930fb7964e2942c88c3416be172c6884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:21:35 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Creating image(s)
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "/opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "/opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "/opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.037s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Cannot resize image /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'migration_context' on Instance uuid 6ed1c5ac-d727-4157-a294-55b49ed26eea {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Ensure instance console log exists: /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG nova.network.neutron [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Successfully created port: b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.223s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk 1073741824" returned: 0 in 0.052s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:21:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Cannot resize image /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG nova.objects.instance [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'migration_context' on Instance uuid 4926037c-8e89-4923-940f-9837b053b9a0 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Ensure instance console log exists: /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.016s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-3b9f1eee-3bb3-4475-a6fa-a9f2cc963d38 req-c9dce207-2143-437b-9f52-225920904de8 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3b9f1eee-3bb3-4475-a6fa-a9f2cc963d38 req-c9dce207-2143-437b-9f52-225920904de8 service nova] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3b9f1eee-3bb3-4475-a6fa-a9f2cc963d38 req-c9dce207-2143-437b-9f52-225920904de8 service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3b9f1eee-3bb3-4475-a6fa-a9f2cc963d38 req-c9dce207-2143-437b-9f52-225920904de8 service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-3b9f1eee-3bb3-4475-a6fa-a9f2cc963d38 req-c9dce207-2143-437b-9f52-225920904de8 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] No waiting events found dispatching network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:21:36 user nova-compute[73520]: WARNING nova.compute.manager [req-3b9f1eee-3bb3-4475-a6fa-a9f2cc963d38 req-c9dce207-2143-437b-9f52-225920904de8 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received unexpected event network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 12:21:36 user nova-compute[73520]: DEBUG nova.network.neutron [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Successfully updated port: b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquired lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:21:36 user nova-compute[73520]: DEBUG nova.network.neutron [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.compute.manager [req-533c71d5-162f-469d-ace7-4652d3f167a8 req-6c93876f-0f75-4409-822b-de1495b0da2c service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-changed-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.compute.manager [req-533c71d5-162f-469d-ace7-4652d3f167a8 req-6c93876f-0f75-4409-822b-de1495b0da2c service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Refreshing instance network info cache due to event network-changed-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-533c71d5-162f-469d-ace7-4652d3f167a8 req-6c93876f-0f75-4409-822b-de1495b0da2c service nova] Acquiring lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.network.neutron [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Updating instance_info_cache with network_info: [{"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Successfully created port: 78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.network.neutron [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Updating instance_info_cache with network_info: [{"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Releasing lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Instance network_info: |[{"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-533c71d5-162f-469d-ace7-4652d3f167a8 req-6c93876f-0f75-4409-822b-de1495b0da2c service nova] Acquired lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.network.neutron [req-533c71d5-162f-469d-ace7-4652d3f167a8 req-6c93876f-0f75-4409-822b-de1495b0da2c service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Refreshing network info cache for port b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Start _get_guest_xml network_info=[{"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:21:37 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:21:37 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-725496249',display_name='tempest-ServerRescueNegativeTestJSON-server-725496249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-725496249',id=25,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930fb7964e2942c88c3416be172c6884',ramdisk_id='',reservation_id='r-9dpq0ryk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-863509458',owner_user_name='tempest-ServerRescueNegativeTestJSON-863509458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:21:34Z,user_data=None,user_id='0d351d0adad3463ebb2e6917a5f91920',uuid=6ed1c5ac-d727-4157-a294-55b49ed26eea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converting VIF {"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=b381ef78-e52f-4f08-a65e-c3b33ac5b5a2,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381ef78-e5') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ed1c5ac-d727-4157-a294-55b49ed26eea {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:21:37 user nova-compute[73520]:   <uuid>6ed1c5ac-d727-4157-a294-55b49ed26eea</uuid>
Aug 16 12:21:37 user nova-compute[73520]:   <name>instance-00000019</name>
Aug 16 12:21:37 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:21:37 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:21:37 user nova-compute[73520]:   <metadata>
Aug 16 12:21:37 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:21:37 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:21:37 user nova-compute[73520]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-725496249</nova:name>
Aug 16 12:21:37 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:21:37</nova:creationTime>
Aug 16 12:21:37 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:21:37 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:21:37 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:21:37 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:21:37 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:21:37 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:21:37 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:21:37 user nova-compute[73520]:       <nova:owner>
Aug 16 12:21:37 user nova-compute[73520]:         <nova:user uuid="0d351d0adad3463ebb2e6917a5f91920">tempest-ServerRescueNegativeTestJSON-863509458-project-member</nova:user>
Aug 16 12:21:37 user nova-compute[73520]:         <nova:project uuid="930fb7964e2942c88c3416be172c6884">tempest-ServerRescueNegativeTestJSON-863509458</nova:project>
Aug 16 12:21:37 user nova-compute[73520]:       </nova:owner>
Aug 16 12:21:37 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:21:37 user nova-compute[73520]:       <nova:ports>
Aug 16 12:21:37 user nova-compute[73520]:         <nova:port uuid="b381ef78-e52f-4f08-a65e-c3b33ac5b5a2">
Aug 16 12:21:37 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 12:21:37 user nova-compute[73520]:         </nova:port>
Aug 16 12:21:37 user nova-compute[73520]:       </nova:ports>
Aug 16 12:21:37 user nova-compute[73520]:     </nova:instance>
Aug 16 12:21:37 user nova-compute[73520]:   </metadata>
Aug 16 12:21:37 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:21:37 user nova-compute[73520]:     <system>
Aug 16 12:21:37 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:21:37 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:21:37 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:21:37 user nova-compute[73520]:       <entry name="serial">6ed1c5ac-d727-4157-a294-55b49ed26eea</entry>
Aug 16 12:21:37 user nova-compute[73520]:       <entry name="uuid">6ed1c5ac-d727-4157-a294-55b49ed26eea</entry>
Aug 16 12:21:37 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:21:37 user nova-compute[73520]:     </system>
Aug 16 12:21:37 user nova-compute[73520]:   </sysinfo>
Aug 16 12:21:37 user nova-compute[73520]:   <os>
Aug 16 12:21:37 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:21:37 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:21:37 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:21:37 user nova-compute[73520]:   </os>
Aug 16 12:21:37 user nova-compute[73520]:   <features>
Aug 16 12:21:37 user nova-compute[73520]:     <acpi/>
Aug 16 12:21:37 user nova-compute[73520]:     <apic/>
Aug 16 12:21:37 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:21:37 user nova-compute[73520]:   </features>
Aug 16 12:21:37 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:21:37 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:21:37 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:21:37 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:21:37 user nova-compute[73520]:   </clock>
Aug 16 12:21:37 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:21:37 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:21:37 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:21:37 user nova-compute[73520]:   </cpu>
Aug 16 12:21:37 user nova-compute[73520]:   <devices>
Aug 16 12:21:37 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:21:37 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:21:37 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk"/>
Aug 16 12:21:37 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:21:37 user nova-compute[73520]:     </disk>
Aug 16 12:21:37 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:21:37 user nova-compute[73520]:       <mac address="fa:16:3e:98:9d:d6"/>
Aug 16 12:21:37 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:21:37 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:21:37 user nova-compute[73520]:       <target dev="tapb381ef78-e5"/>
Aug 16 12:21:37 user nova-compute[73520]:     </interface>
Aug 16 12:21:37 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:21:37 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/console.log" append="off"/>
Aug 16 12:21:37 user nova-compute[73520]:     </serial>
Aug 16 12:21:37 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:21:37 user nova-compute[73520]:     <video>
Aug 16 12:21:37 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:21:37 user nova-compute[73520]:     </video>
Aug 16 12:21:37 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:21:37 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:21:37 user nova-compute[73520]:     </rng>
Aug 16 12:21:37 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:21:37 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:21:37 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:21:37 user nova-compute[73520]:     </memballoon>
Aug 16 12:21:37 user nova-compute[73520]:   </devices>
Aug 16 12:21:37 user nova-compute[73520]: </domain>
Aug 16 12:21:37 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-725496249',display_name='tempest-ServerRescueNegativeTestJSON-server-725496249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-725496249',id=25,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930fb7964e2942c88c3416be172c6884',ramdisk_id='',reservation_id='r-9dpq0ryk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-863509458',owner_user_name='tempest-ServerRescueNegativeTestJSON-863509458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:21:34Z,user_data=None,user_id='0d351d0adad3463ebb2e6917a5f91920',uuid=6ed1c5ac-d727-4157-a294-55b49ed26eea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converting VIF {"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=b381ef78-e52f-4f08-a65e-c3b33ac5b5a2,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381ef78-e5') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG os_vif [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=b381ef78-e52f-4f08-a65e-c3b33ac5b5a2,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381ef78-e5') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb381ef78-e5, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb381ef78-e5, col_values=(('external_ids', {'iface-id': 'b381ef78-e52f-4f08-a65e-c3b33ac5b5a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:9d:d6', 'vm-uuid': '6ed1c5ac-d727-4157-a294-55b49ed26eea'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:37 user nova-compute[73520]: INFO os_vif [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=b381ef78-e52f-4f08-a65e-c3b33ac5b5a2,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381ef78-e5')
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No VIF found with MAC fa:16:3e:98:9d:d6, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:21:38 user nova-compute[73520]: INFO nova.compute.claims [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Claim successful on node user
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.network.neutron [req-533c71d5-162f-469d-ace7-4652d3f167a8 req-6c93876f-0f75-4409-822b-de1495b0da2c service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Updated VIF entry in instance network info cache for port b381ef78-e52f-4f08-a65e-c3b33ac5b5a2. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.network.neutron [req-533c71d5-162f-469d-ace7-4652d3f167a8 req-6c93876f-0f75-4409-822b-de1495b0da2c service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Updating instance_info_cache with network_info: [{"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-533c71d5-162f-469d-ace7-4652d3f167a8 req-6c93876f-0f75-4409-822b-de1495b0da2c service nova] Releasing lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Successfully updated port: 78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquired lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-882d2df7-e1c4-48e8-9610-953ac4b3a26c req-f5d190d0-4009-4f8a-bc80-65c7a026bd2c service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received event network-changed-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-882d2df7-e1c4-48e8-9610-953ac4b3a26c req-f5d190d0-4009-4f8a-bc80-65c7a026bd2c service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Refreshing instance network info cache due to event network-changed-78cef49e-d317-4d37-8da3-d72d0b755c2d. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-882d2df7-e1c4-48e8-9610-953ac4b3a26c req-f5d190d0-4009-4f8a-bc80-65c7a026bd2c service nova] Acquiring lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-715ce5d3-877e-443d-80e8-b4f5c8ebc7ef req-3e25d114-9aac-4bc8-8366-e38562f72013 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-715ce5d3-877e-443d-80e8-b4f5c8ebc7ef req-3e25d114-9aac-4bc8-8366-e38562f72013 service nova] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-715ce5d3-877e-443d-80e8-b4f5c8ebc7ef req-3e25d114-9aac-4bc8-8366-e38562f72013 service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-715ce5d3-877e-443d-80e8-b4f5c8ebc7ef req-3e25d114-9aac-4bc8-8366-e38562f72013 service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-715ce5d3-877e-443d-80e8-b4f5c8ebc7ef req-3e25d114-9aac-4bc8-8366-e38562f72013 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] No waiting events found dispatching network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:21:38 user nova-compute[73520]: WARNING nova.compute.manager [req-715ce5d3-877e-443d-80e8-b4f5c8ebc7ef req-3e25d114-9aac-4bc8-8366-e38562f72013 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received unexpected event network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 12:21:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Updating instance_info_cache with network_info: [{"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188498.9423847, b58731e0-399d-4f8d-84b8-af12a46cf87f => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:21:38 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] VM Resumed (Lifecycle Event)
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Releasing lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Instance network_info: |[{"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-882d2df7-e1c4-48e8-9610-953ac4b3a26c req-f5d190d0-4009-4f8a-bc80-65c7a026bd2c service nova] Acquired lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.network.neutron [req-882d2df7-e1c4-48e8-9610-953ac4b3a26c req-f5d190d0-4009-4f8a-bc80-65c7a026bd2c service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Refreshing network info cache for port 78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:21:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Start _get_guest_xml network_info=[{"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:21:39 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Instance spawned successfully.
Aug 16 12:21:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.891s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:21:39 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188498.9426394, b58731e0-399d-4f8d-84b8-af12a46cf87f => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:21:39 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] VM Started (Lifecycle Event)
Aug 16 12:21:39 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:21:39 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-978581289',display_name='tempest-ServerRescueNegativeTestJSON-server-978581289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-978581289',id=26,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930fb7964e2942c88c3416be172c6884',ramdisk_id='',reservation_id='r-gkbk7dsy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-863509458',owner_user_name='tempest-ServerRescueNegativeTestJSON-863509458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:21:35Z,user_data=None,user_id='0d351d0adad3463ebb2e6917a5f91920',uuid=4926037c-8e89-4923-940f-9837b053b9a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converting VIF {"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:58:db,bridge_name='br-int',has_traffic_filtering=True,id=78cef49e-d317-4d37-8da3-d72d0b755c2d,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78cef49e-d3') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.objects.instance [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'pci_devices' on Instance uuid 4926037c-8e89-4923-940f-9837b053b9a0 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:21:39 user nova-compute[73520]:   <uuid>4926037c-8e89-4923-940f-9837b053b9a0</uuid>
Aug 16 12:21:39 user nova-compute[73520]:   <name>instance-0000001a</name>
Aug 16 12:21:39 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:21:39 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:21:39 user nova-compute[73520]:   <metadata>
Aug 16 12:21:39 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:21:39 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:21:39 user nova-compute[73520]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-978581289</nova:name>
Aug 16 12:21:39 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:21:39</nova:creationTime>
Aug 16 12:21:39 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:21:39 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:21:39 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:21:39 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:21:39 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:21:39 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:21:39 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:21:39 user nova-compute[73520]:       <nova:owner>
Aug 16 12:21:39 user nova-compute[73520]:         <nova:user uuid="0d351d0adad3463ebb2e6917a5f91920">tempest-ServerRescueNegativeTestJSON-863509458-project-member</nova:user>
Aug 16 12:21:39 user nova-compute[73520]:         <nova:project uuid="930fb7964e2942c88c3416be172c6884">tempest-ServerRescueNegativeTestJSON-863509458</nova:project>
Aug 16 12:21:39 user nova-compute[73520]:       </nova:owner>
Aug 16 12:21:39 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:21:39 user nova-compute[73520]:       <nova:ports>
Aug 16 12:21:39 user nova-compute[73520]:         <nova:port uuid="78cef49e-d317-4d37-8da3-d72d0b755c2d">
Aug 16 12:21:39 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 12:21:39 user nova-compute[73520]:         </nova:port>
Aug 16 12:21:39 user nova-compute[73520]:       </nova:ports>
Aug 16 12:21:39 user nova-compute[73520]:     </nova:instance>
Aug 16 12:21:39 user nova-compute[73520]:   </metadata>
Aug 16 12:21:39 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:21:39 user nova-compute[73520]:     <system>
Aug 16 12:21:39 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:21:39 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:21:39 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:21:39 user nova-compute[73520]:       <entry name="serial">4926037c-8e89-4923-940f-9837b053b9a0</entry>
Aug 16 12:21:39 user nova-compute[73520]:       <entry name="uuid">4926037c-8e89-4923-940f-9837b053b9a0</entry>
Aug 16 12:21:39 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:21:39 user nova-compute[73520]:     </system>
Aug 16 12:21:39 user nova-compute[73520]:   </sysinfo>
Aug 16 12:21:39 user nova-compute[73520]:   <os>
Aug 16 12:21:39 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:21:39 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:21:39 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:21:39 user nova-compute[73520]:   </os>
Aug 16 12:21:39 user nova-compute[73520]:   <features>
Aug 16 12:21:39 user nova-compute[73520]:     <acpi/>
Aug 16 12:21:39 user nova-compute[73520]:     <apic/>
Aug 16 12:21:39 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:21:39 user nova-compute[73520]:   </features>
Aug 16 12:21:39 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:21:39 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:21:39 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:21:39 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:21:39 user nova-compute[73520]:   </clock>
Aug 16 12:21:39 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:21:39 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:21:39 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:21:39 user nova-compute[73520]:   </cpu>
Aug 16 12:21:39 user nova-compute[73520]:   <devices>
Aug 16 12:21:39 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:21:39 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:21:39 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk"/>
Aug 16 12:21:39 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:21:39 user nova-compute[73520]:     </disk>
Aug 16 12:21:39 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:21:39 user nova-compute[73520]:       <mac address="fa:16:3e:a8:58:db"/>
Aug 16 12:21:39 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:21:39 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:21:39 user nova-compute[73520]:       <target dev="tap78cef49e-d3"/>
Aug 16 12:21:39 user nova-compute[73520]:     </interface>
Aug 16 12:21:39 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:21:39 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/console.log" append="off"/>
Aug 16 12:21:39 user nova-compute[73520]:     </serial>
Aug 16 12:21:39 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:21:39 user nova-compute[73520]:     <video>
Aug 16 12:21:39 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:21:39 user nova-compute[73520]:     </video>
Aug 16 12:21:39 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:21:39 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:21:39 user nova-compute[73520]:     </rng>
Aug 16 12:21:39 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:21:39 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:21:39 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:21:39 user nova-compute[73520]:     </memballoon>
Aug 16 12:21:39 user nova-compute[73520]:   </devices>
Aug 16 12:21:39 user nova-compute[73520]: </domain>
Aug 16 12:21:39 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-978581289',display_name='tempest-ServerRescueNegativeTestJSON-server-978581289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-978581289',id=26,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930fb7964e2942c88c3416be172c6884',ramdisk_id='',reservation_id='r-gkbk7dsy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-863509458',owner_user_name='tempest-ServerRescueNegativeTestJSON-863509458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:21:35Z,user_data=None,user_id='0d351d0adad3463ebb2e6917a5f91920',uuid=4926037c-8e89-4923-940f-9837b053b9a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converting VIF {"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:58:db,bridge_name='br-int',has_traffic_filtering=True,id=78cef49e-d317-4d37-8da3-d72d0b755c2d,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78cef49e-d3') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG os_vif [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:58:db,bridge_name='br-int',has_traffic_filtering=True,id=78cef49e-d317-4d37-8da3-d72d0b755c2d,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78cef49e-d3') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78cef49e-d3, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap78cef49e-d3, col_values=(('external_ids', {'iface-id': '78cef49e-d317-4d37-8da3-d72d0b755c2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:58:db', 'vm-uuid': '4926037c-8e89-4923-940f-9837b053b9a0'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:21:39 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:21:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:39 user nova-compute[73520]: INFO os_vif [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:58:db,bridge_name='br-int',has_traffic_filtering=True,id=78cef49e-d317-4d37-8da3-d72d0b755c2d,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78cef49e-d3')
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.policy [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d1e9417253f43b482e8ee5b3109a697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3756b80f2243dca0b31ffea7438b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:21:39 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:21:39 user nova-compute[73520]: INFO nova.virt.block_device [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Booting with blank volume at /dev/vda
Aug 16 12:21:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No VIF found with MAC fa:16:3e:a8:58:db, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d235c913-cfed-4bca-b9a9-e7c994797e53 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.717s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.network.neutron [req-882d2df7-e1c4-48e8-9610-953ac4b3a26c req-f5d190d0-4009-4f8a-bc80-65c7a026bd2c service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Updated VIF entry in instance network info cache for port 78cef49e-d317-4d37-8da3-d72d0b755c2d. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG nova.network.neutron [req-882d2df7-e1c4-48e8-9610-953ac4b3a26c req-f5d190d0-4009-4f8a-bc80-65c7a026bd2c service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Updating instance_info_cache with network_info: [{"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-882d2df7-e1c4-48e8-9610-953ac4b3a26c req-f5d190d0-4009-4f8a-bc80-65c7a026bd2c service nova] Releasing lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-22b34ce7-bef1-478d-9c6a-524a629b0d11 req-ac093b44-abe5-4a5e-9e86-b740bfe18c1b service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-22b34ce7-bef1-478d-9c6a-524a629b0d11 req-ac093b44-abe5-4a5e-9e86-b740bfe18c1b service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-22b34ce7-bef1-478d-9c6a-524a629b0d11 req-ac093b44-abe5-4a5e-9e86-b740bfe18c1b service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-22b34ce7-bef1-478d-9c6a-524a629b0d11 req-ac093b44-abe5-4a5e-9e86-b740bfe18c1b service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-22b34ce7-bef1-478d-9c6a-524a629b0d11 req-ac093b44-abe5-4a5e-9e86-b740bfe18c1b service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:21:40 user nova-compute[73520]: WARNING nova.compute.manager [req-22b34ce7-bef1-478d-9c6a-524a629b0d11 req-ac093b44-abe5-4a5e-9e86-b740bfe18c1b service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state building and task_state spawning.
Aug 16 12:21:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Successfully created port: c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-79842587-2bb8-4ffa-ab5e-580ace97dff1 req-ae109b68-b9a2-4e8a-bb06-e5eec8f61bce service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received event network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-79842587-2bb8-4ffa-ab5e-580ace97dff1 req-ae109b68-b9a2-4e8a-bb06-e5eec8f61bce service nova] Acquiring lock "4926037c-8e89-4923-940f-9837b053b9a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-79842587-2bb8-4ffa-ab5e-580ace97dff1 req-ae109b68-b9a2-4e8a-bb06-e5eec8f61bce service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-79842587-2bb8-4ffa-ab5e-580ace97dff1 req-ae109b68-b9a2-4e8a-bb06-e5eec8f61bce service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-79842587-2bb8-4ffa-ab5e-580ace97dff1 req-ae109b68-b9a2-4e8a-bb06-e5eec8f61bce service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] No waiting events found dispatching network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:21:41 user nova-compute[73520]: WARNING nova.compute.manager [req-79842587-2bb8-4ffa-ab5e-580ace97dff1 req-ae109b68-b9a2-4e8a-bb06-e5eec8f61bce service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received unexpected event network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d for instance with vm_state building and task_state spawning.
Aug 16 12:21:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:41 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Successfully updated port: c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:21:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:21:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquired lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:21:42 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:21:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:21:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:21:42 user nova-compute[73520]: WARNING nova.compute.manager [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state building and task_state spawning.
Aug 16 12:21:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-changed-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Refreshing instance network info cache due to event network-changed-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:21:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] Acquiring lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188503.5330474, 6ed1c5ac-d727-4157-a294-55b49ed26eea => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:21:44 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] VM Resumed (Lifecycle Event)
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.objects.instance [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'flavor' on Instance uuid 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-467269c8-ab07-445b-b163-53d2cc86245f req-b915915a-1094-4d3e-bb7b-7ba21782c8f6 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received event network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-467269c8-ab07-445b-b163-53d2cc86245f req-b915915a-1094-4d3e-bb7b-7ba21782c8f6 service nova] Acquiring lock "4926037c-8e89-4923-940f-9837b053b9a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-467269c8-ab07-445b-b163-53d2cc86245f req-b915915a-1094-4d3e-bb7b-7ba21782c8f6 service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-467269c8-ab07-445b-b163-53d2cc86245f req-b915915a-1094-4d3e-bb7b-7ba21782c8f6 service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-467269c8-ab07-445b-b163-53d2cc86245f req-b915915a-1094-4d3e-bb7b-7ba21782c8f6 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] No waiting events found dispatching network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:21:44 user nova-compute[73520]: WARNING nova.compute.manager [req-467269c8-ab07-445b-b163-53d2cc86245f req-b915915a-1094-4d3e-bb7b-7ba21782c8f6 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received unexpected event network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d for instance with vm_state building and task_state spawning.
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCzWqIQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:21:44 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:21:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:21:44 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:21:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:21:44 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:44 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Instance spawned successfully.
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:21:44 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:21:44 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7438MB free_disk=25.343608856201172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-89abf86c-5770-4152-a3fe-837caa28d36b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 15.649s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7dd00-4572-4815-913f-386f4989da32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:44 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Instance spawned successfully.
Aug 16 12:21:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:21:44 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:44 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188503.5353417, 6ed1c5ac-d727-4157-a294-55b49ed26eea => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:21:44 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] VM Started (Lifecycle Event)
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.088s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e23455-5653-4616-a326-e6b10af1bf88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c] added
Aug 16 12:21:44 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.077s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[738ad562-4f87-4851-8f9b-cde69289f579]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:21:44 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188504.0508363, 4926037c-8e89-4923-940f-9837b053b9a0 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:21:44 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] VM Resumed (Lifecycle Event)
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.046s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab272e9-c131-4d1c-8e05-091cb2637e01]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tCzWqIQA {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 91e479f7-5fc0-46d2-9c02-52175084fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 70eeda03-767e-4c60-b535-9b250b63513b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 9ab085c8-d666-4525-bee5-d61aada89a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance e3236316-dada-4aee-a210-6d9e9950c166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance b58731e0-399d-4f8d-84b8-af12a46cf87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tCzWqIQA" returned: 0 in 0.069s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[620a225d-48c3-4921-8f6f-fe34ffa4c744]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tCzWqIQA'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f92ba5f-edb9-4242-9105-bcc49123d365]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:44 user nova-compute[73520]: INFO nova.compute.manager [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Took 10.87 seconds to spawn the instance on the hypervisor.
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:44 user nova-compute[73520]: INFO nova.compute.manager [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Took 9.79 seconds to spawn the instance on the hypervisor.
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[81276866-df0a-414a-a022-f89a2385eb35]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:44 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:21:44 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188504.0526705, 4926037c-8e89-4923-940f-9837b053b9a0 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:21:44 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] VM Started (Lifecycle Event)
Aug 16 12:21:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:21:44 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:21:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:21:44 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eae984-85e3-4512-ab00-9111c1df4769]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:45 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c, portal: 172.16.0.220,3260]
Aug 16 12:21:45 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c, portal: 172.16.0.220,3260] successful.
Aug 16 12:21:45 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:45 user nova-compute[73520]: INFO nova.compute.manager [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Took 11.77 seconds to build instance.
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a023dc5-ca4f-4355-b512-3fd7f0cf9331]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9b22b71a-09bc-4131-9846-4ca0285d7d49 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.908s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:45 user nova-compute[73520]: INFO nova.compute.manager [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Took 11.24 seconds to build instance.
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcc4e4b-e803-469e-9c32-824224fecb19]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:21:45 user nova-compute[73520]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c (non-flash)
Aug 16 12:21:45 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:21:45 user nova-compute[73520]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c (non-flash)
Aug 16 12:21:45 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.612s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6fd5b3f9-1d7a-4ef1-acc1-6d82e6b01582 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "4926037c-8e89-4923-940f-9837b053b9a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.351s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.041s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d3ce7f-b4ed-4c67-b8bb-3b1e1fa55119]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCzWqIQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-18fffa5d-e945-4cb8-9463-6d31d7f0811d req-b753892d-1580-4a06-9446-0b117622b84b service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Received event network-changed-4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-18fffa5d-e945-4cb8-9463-6d31d7f0811d req-b753892d-1580-4a06-9446-0b117622b84b service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Refreshing instance network info cache due to event network-changed-4236a073-45ce-42b4-bedd-e568a6ed5ebd. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-18fffa5d-e945-4cb8-9463-6d31d7f0811d req-b753892d-1580-4a06-9446-0b117622b84b service nova] Acquiring lock "refresh_cache-9ab085c8-d666-4525-bee5-d61aada89a7a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-18fffa5d-e945-4cb8-9463-6d31d7f0811d req-b753892d-1580-4a06-9446-0b117622b84b service nova] Acquired lock "refresh_cache-9ab085c8-d666-4525-bee5-d61aada89a7a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG nova.network.neutron [req-18fffa5d-e945-4cb8-9463-6d31d7f0811d req-b753892d-1580-4a06-9446-0b117622b84b service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Refreshing network info cache for port 4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Updating instance_info_cache with network_info: [{"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Releasing lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Instance network_info: |[{"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] Acquired lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG nova.network.neutron [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Refreshing network info cache for port c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.utils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdf1cd7-92b5-455d-bba0-c056fb22be22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0c13e0-4ea8-478c-8090-500386333f38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[08191941-aa84-43af-8735-461f79830c26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca97f3d-e2a5-45f9-b9d9-0a3a577a810f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.120s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:21:45 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:21:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56f5fc7-1b14-4cc0-be71-83eda107c022]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG os_brick.utils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:21:45 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Updating existing volume attachment record: 5736cb09-9187-493f-81c6-ae9b1247a4a3 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG nova.network.neutron [req-18fffa5d-e945-4cb8-9463-6d31d7f0811d req-b753892d-1580-4a06-9446-0b117622b84b service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Updated VIF entry in instance network info cache for port 4236a073-45ce-42b4-bedd-e568a6ed5ebd. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG nova.network.neutron [req-18fffa5d-e945-4cb8-9463-6d31d7f0811d req-b753892d-1580-4a06-9446-0b117622b84b service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Updating instance_info_cache with network_info: [{"id": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "address": "fa:16:3e:ac:d9:71", "network": {"id": "e1920a82-145c-47c4-ba96-97c266bb7208", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-763027158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5436806c15a841fa8b3caec7bc2c60a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4236a073-45", "ovs_interfaceid": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.687s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] <== connect_volume: return (1689ms) {'type': 'block', 'scsi_wwn': '23963613832656166', 'path': '/dev/sdc'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963613832656166', 'path': '/dev/sdc'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG nova.network.neutron [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Updated VIF entry in instance network info cache for port c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG nova.network.neutron [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Updating instance_info_cache with network_info: [{"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-18fffa5d-e945-4cb8-9463-6d31d7f0811d req-b753892d-1580-4a06-9446-0b117622b84b service nova] Releasing lock "refresh_cache-9ab085c8-d666-4525-bee5-d61aada89a7a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'flavor' on Instance uuid 70eeda03-767e-4c60-b535-9b250b63513b {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f98cafd4-0b39-4889-aa9f-ddc7e70bd698 req-d5fa8742-cfdf-45b7-9a01-ec945f77e504 service nova] Releasing lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:21:46 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:21:46 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:21:46 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:21:46 user nova-compute[73520]:   <serial>3a8077f6-24b9-43c4-a30a-4d1ff808159c</serial>
Aug 16 12:21:46 user nova-compute[73520]: </disk>
Aug 16 12:21:46 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "9ab085c8-d666-4525-bee5-d61aada89a7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG nova.objects.instance [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lazy-loading 'flavor' on Instance uuid 9ab085c8-d666-4525-bee5-d61aada89a7a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.119s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No VIF found with MAC fa:16:3e:3c:be:f7, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "9ab085c8-d666-4525-bee5-d61aada89a7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:46 user nova-compute[73520]: INFO nova.compute.manager [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Attaching volume 83583c58-4e44-4aee-85a7-a6f5f86ed899 to /dev/vdb
Aug 16 12:21:47 user nova-compute[73520]: DEBUG os_brick.utils [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9ec24d47-a6c1-4c41-8a03-79ae0296491f tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "70eeda03-767e-4c60-b535-9b250b63513b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.249s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f46b72c-6a4c-4075-980f-0a99f99a325c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3829225d-4dd1-4156-a133-7bf3d1102482]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad049ccc-3c3d-415b-8013-c5c251240d66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b7e366-14c0-4f00-a39c-eb5832fc57c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:21:47 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb34cee5-9e99-4a0c-908a-c26dbfd2f6dd]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG os_brick.utils [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Updating existing volume attachment record: 1db0c7ca-6e4f-4124-85c8-8fdef02aa231 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:21:47 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:21:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "70eeda03-767e-4c60-b535-9b250b63513b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:21:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "70eeda03-767e-4c60-b535-9b250b63513b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:21:48 user nova-compute[73520]: INFO nova.compute.manager [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Detaching volume 3a8077f6-24b9-43c4-a30a-4d1ff808159c
Aug 16 12:21:48 user nova-compute[73520]: INFO nova.virt.block_device [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Attempting to driver detach volume 3a8077f6-24b9-43c4-a30a-4d1ff808159c from mountpoint /dev/vdb
Aug 16 12:21:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Attempting to detach device vdb from instance 70eeda03-767e-4c60-b535-9b250b63513b from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:21:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:21:48 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:21:48 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:21:48 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:21:48 user nova-compute[73520]:   <serial>3a8077f6-24b9-43c4-a30a-4d1ff808159c</serial>
Aug 16 12:21:48 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:21:48 user nova-compute[73520]: </disk>
Aug 16 12:21:48 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:21:48 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully detached device vdb from instance 70eeda03-767e-4c60-b535-9b250b63513b from the persistent domain config.
Aug 16 12:21:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 70eeda03-767e-4c60-b535-9b250b63513b from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:21:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:21:48 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:21:48 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:21:48 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:21:48 user nova-compute[73520]:   <serial>3a8077f6-24b9-43c4-a30a-4d1ff808159c</serial>
Aug 16 12:21:48 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:21:48 user nova-compute[73520]: </disk>
Aug 16 12:21:48 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:21:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188509.1824567, 70eeda03-767e-4c60-b535-9b250b63513b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 70eeda03-767e-4c60-b535-9b250b63513b {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:21:49 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully detached device vdb from instance 70eeda03-767e-4c60-b535-9b250b63513b from the live domain config.
Aug 16 12:21:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCzWqIQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:21:49 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[723a3522-638c-4049-a240-c5881785ae39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa5d1f2-7346-49fd-a015-7d2642cda39f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:21:49 user nova-compute[73520]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c (non-flash)
Aug 16 12:21:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:21:49 user nova-compute[73520]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c (non-flash)
Aug 16 12:21:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c7aeb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c'): ({'sdc'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Removing single pathed devices sdc {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6726b5-5afe-47c6-877d-4cfccc8897fc]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[928b2d04-6f8d-4932-94df-c30f83c3a0a2]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Flushing IO for device /dev/sdc {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e6f14f-b55a-4c6b-a60e-0dea0658345f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5f554c-d321-4fac-9cff-cbe2316f5f69]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[842d727a-713f-4df9-9869-9023fb9a229c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54fb877-3c3b-411b-9c26-cdeceb3e6766]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c, portal: 172.16.0.220,3260]
Aug 16 12:21:49 user nova-compute[73520]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c, portal: 172.16.0.220,3260] successful.
Aug 16 12:21:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8077f6-24b9-43c4-a30a-4d1ff808159c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b034c6-4056-49c4-a3c1-354aaee33d8c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] <== disconnect_volume: return (348ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:21:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:21:50 user nova-compute[73520]: DEBUG nova.objects.instance [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'flavor' on Instance uuid 70eeda03-767e-4c60-b535-9b250b63513b {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:21:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eb45a110-1298-493e-a55a-db085ee640c6 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "70eeda03-767e-4c60-b535-9b250b63513b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.301s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:21:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:21:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:22:00 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Creating image(s)
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Ensure instance console log exists: /opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Start _get_guest_xml network_info=[{"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKbLeqTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ba7e17f9-c32c-425d-a1ae-3e2cf9c44752', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6d21150-539b-46cc-a671-ba0feeef3c7c', 'serial': 'd6d21150-539b-46cc-a671-ba0feeef3c7c'}, 'attachment_id': '5736cb09-9187-493f-81c6-ae9b1247a4a3', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:22:00 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:22:00 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKbLeqTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:22:00 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:22:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:22:00 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:22:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:22:00 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f279bc-3caa-460e-96bb-838edeb04550]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:22:00 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb8046-0949-4c62-9d50-7aaa4a7337ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c] added
Aug 16 12:22:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78aaf67-ef1e-4bac-becb-126a7da6f793]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ad88f1-b8dd-4f63-bd79-4446df9c2cbe]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKbLeqTJ {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKbLeqTJ" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6b3d2b-99b2-4bb4-baca-731aa75fc454]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iKbLeqTJ'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc450692-bd22-4c8a-ab76-5894bd328022]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d2ce08-22ef-4a96-80bc-b14414537d0f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:22:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6245718d-4bed-4dbd-97a3-25251bacb47c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c, portal: 172.16.0.220,3260]
Aug 16 12:22:01 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c, portal: 172.16.0.220,3260] successful.
Aug 16 12:22:01 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3158664-9e71-4d9c-947e-f6239c480be3]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[46202ce5-2a3e-46a9-af8d-2c2102baeb6f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:01 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:01 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:01 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:01 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea46dc2-11c0-40de-b22a-bd3a4fd6ada8]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:22:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKbLeqTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23961336537333764', 'path': '/dev/sdc'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961336537333764', 'path': '/dev/sdc'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1670743928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1670743928',id=27,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-tusldpqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:21:39Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=ba7e17f9-c32c-425d-a1ae-3e2cf9c44752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:4b:42,bridge_name='br-int',has_traffic_filtering=True,id=c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bbbe2f-5b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG nova.objects.instance [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'pci_devices' on Instance uuid ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:22:02 user nova-compute[73520]:   <uuid>ba7e17f9-c32c-425d-a1ae-3e2cf9c44752</uuid>
Aug 16 12:22:02 user nova-compute[73520]:   <name>instance-0000001b</name>
Aug 16 12:22:02 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:22:02 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:22:02 user nova-compute[73520]:   <metadata>
Aug 16 12:22:02 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:22:02 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:22:02 user nova-compute[73520]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1670743928</nova:name>
Aug 16 12:22:02 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:22:00</nova:creationTime>
Aug 16 12:22:02 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:22:02 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:22:02 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:22:02 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:22:02 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:22:02 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:22:02 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:22:02 user nova-compute[73520]:       <nova:owner>
Aug 16 12:22:02 user nova-compute[73520]:         <nova:user uuid="3d1e9417253f43b482e8ee5b3109a697">tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member</nova:user>
Aug 16 12:22:02 user nova-compute[73520]:         <nova:project uuid="4d3756b80f2243dca0b31ffea7438b5d">tempest-ServerBootFromVolumeStableRescueTest-1104312883</nova:project>
Aug 16 12:22:02 user nova-compute[73520]:       </nova:owner>
Aug 16 12:22:02 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:22:02 user nova-compute[73520]:       <nova:ports>
Aug 16 12:22:02 user nova-compute[73520]:         <nova:port uuid="c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b">
Aug 16 12:22:02 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 12:22:02 user nova-compute[73520]:         </nova:port>
Aug 16 12:22:02 user nova-compute[73520]:       </nova:ports>
Aug 16 12:22:02 user nova-compute[73520]:     </nova:instance>
Aug 16 12:22:02 user nova-compute[73520]:   </metadata>
Aug 16 12:22:02 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:22:02 user nova-compute[73520]:     <system>
Aug 16 12:22:02 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:22:02 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:22:02 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:22:02 user nova-compute[73520]:       <entry name="serial">ba7e17f9-c32c-425d-a1ae-3e2cf9c44752</entry>
Aug 16 12:22:02 user nova-compute[73520]:       <entry name="uuid">ba7e17f9-c32c-425d-a1ae-3e2cf9c44752</entry>
Aug 16 12:22:02 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:22:02 user nova-compute[73520]:     </system>
Aug 16 12:22:02 user nova-compute[73520]:   </sysinfo>
Aug 16 12:22:02 user nova-compute[73520]:   <os>
Aug 16 12:22:02 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:22:02 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:22:02 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:22:02 user nova-compute[73520]:   </os>
Aug 16 12:22:02 user nova-compute[73520]:   <features>
Aug 16 12:22:02 user nova-compute[73520]:     <acpi/>
Aug 16 12:22:02 user nova-compute[73520]:     <apic/>
Aug 16 12:22:02 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:22:02 user nova-compute[73520]:   </features>
Aug 16 12:22:02 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:22:02 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:22:02 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:22:02 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:22:02 user nova-compute[73520]:   </clock>
Aug 16 12:22:02 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:22:02 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:22:02 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:22:02 user nova-compute[73520]:   </cpu>
Aug 16 12:22:02 user nova-compute[73520]:   <devices>
Aug 16 12:22:02 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:22:02 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:22:02 user nova-compute[73520]:       <source dev="/dev/sdc"/>
Aug 16 12:22:02 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:22:02 user nova-compute[73520]:       <serial>d6d21150-539b-46cc-a671-ba0feeef3c7c</serial>
Aug 16 12:22:02 user nova-compute[73520]:     </disk>
Aug 16 12:22:02 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:22:02 user nova-compute[73520]:       <mac address="fa:16:3e:79:4b:42"/>
Aug 16 12:22:02 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:22:02 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:22:02 user nova-compute[73520]:       <target dev="tapc0bbbe2f-5b"/>
Aug 16 12:22:02 user nova-compute[73520]:     </interface>
Aug 16 12:22:02 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:22:02 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/console.log" append="off"/>
Aug 16 12:22:02 user nova-compute[73520]:     </serial>
Aug 16 12:22:02 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:22:02 user nova-compute[73520]:     <video>
Aug 16 12:22:02 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:22:02 user nova-compute[73520]:     </video>
Aug 16 12:22:02 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:22:02 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:22:02 user nova-compute[73520]:     </rng>
Aug 16 12:22:02 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:22:02 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:22:02 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:22:02 user nova-compute[73520]:     </memballoon>
Aug 16 12:22:02 user nova-compute[73520]:   </devices>
Aug 16 12:22:02 user nova-compute[73520]: </domain>
Aug 16 12:22:02 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1670743928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1670743928',id=27,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-tusldpqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:21:39Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=ba7e17f9-c32c-425d-a1ae-3e2cf9c44752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:4b:42,bridge_name='br-int',has_traffic_filtering=True,id=c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bbbe2f-5b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG os_vif [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:4b:42,bridge_name='br-int',has_traffic_filtering=True,id=c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bbbe2f-5b') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0bbbe2f-5b, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0bbbe2f-5b, col_values=(('external_ids', {'iface-id': 'c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:4b:42', 'vm-uuid': 'ba7e17f9-c32c-425d-a1ae-3e2cf9c44752'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:02 user nova-compute[73520]: INFO os_vif [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:4b:42,bridge_name='br-int',has_traffic_filtering=True,id=c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bbbe2f-5b')
Aug 16 12:22:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:22:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No VIF found with MAC fa:16:3e:79:4b:42, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:22:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-cfb53261-03b8-4710-8c5e-574b2901910e req-18617142-8d77-42cc-8877-30ef6376d0c4 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cfb53261-03b8-4710-8c5e-574b2901910e req-18617142-8d77-42cc-8877-30ef6376d0c4 service nova] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cfb53261-03b8-4710-8c5e-574b2901910e req-18617142-8d77-42cc-8877-30ef6376d0c4 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cfb53261-03b8-4710-8c5e-574b2901910e req-18617142-8d77-42cc-8877-30ef6376d0c4 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-cfb53261-03b8-4710-8c5e-574b2901910e req-18617142-8d77-42cc-8877-30ef6376d0c4 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] No waiting events found dispatching network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:03 user nova-compute[73520]: WARNING nova.compute.manager [req-cfb53261-03b8-4710-8c5e-574b2901910e req-18617142-8d77-42cc-8877-30ef6376d0c4 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received unexpected event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b for instance with vm_state building and task_state spawning.
Aug 16 12:22:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "3fcba05a-678c-403f-be48-bd22095facd4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "3fcba05a-678c-403f-be48-bd22095facd4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:22:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:22:05 user nova-compute[73520]: INFO nova.compute.claims [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Claim successful on node user
Aug 16 12:22:05 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188525.9636536, ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:22:05 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] VM Resumed (Lifecycle Event)
Aug 16 12:22:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:22:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:22:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Instance spawned successfully.
Aug 16 12:22:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.compute.manager [req-b5f4b7b5-7e2a-4e4e-9558-9188795f4f14 req-7121e536-082d-4665-842b-19fdc6d057cb service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b5f4b7b5-7e2a-4e4e-9558-9188795f4f14 req-7121e536-082d-4665-842b-19fdc6d057cb service nova] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b5f4b7b5-7e2a-4e4e-9558-9188795f4f14 req-7121e536-082d-4665-842b-19fdc6d057cb service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b5f4b7b5-7e2a-4e4e-9558-9188795f4f14 req-7121e536-082d-4665-842b-19fdc6d057cb service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.compute.manager [req-b5f4b7b5-7e2a-4e4e-9558-9188795f4f14 req-7121e536-082d-4665-842b-19fdc6d057cb service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] No waiting events found dispatching network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:06 user nova-compute[73520]: WARNING nova.compute.manager [req-b5f4b7b5-7e2a-4e4e-9558-9188795f4f14 req-7121e536-082d-4665-842b-19fdc6d057cb service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received unexpected event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b for instance with vm_state building and task_state spawning.
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:22:06 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188525.9678092, ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:22:06 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] VM Started (Lifecycle Event)
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:22:06 user nova-compute[73520]: INFO nova.compute.manager [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Took 5.48 seconds to spawn the instance on the hypervisor.
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:22:06 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:22:06 user nova-compute[73520]: INFO nova.compute.manager [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Took 28.15 seconds to build instance.
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cff033b6-8edd-4c46-8e70-60a1b4d23c93 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.299s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.network.neutron [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:22:06 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.policy [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '223a4316eda946d38dd77143a4847484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2639b61de64add87f6510f520aa158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:22:06 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Creating image(s)
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "/opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "/opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk 1073741824" returned: 0 in 0.061s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Successfully created port: 7e0d5e6e-9976-4b42-b655-10b9737e03fc {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.220s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Cannot resize image /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG nova.objects.instance [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lazy-loading 'migration_context' on Instance uuid 3fcba05a-678c-403f-be48-bd22095facd4 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Ensure instance console log exists: /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Successfully updated port: 7e0d5e6e-9976-4b42-b655-10b9737e03fc {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "refresh_cache-3fcba05a-678c-403f-be48-bd22095facd4" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquired lock "refresh_cache-3fcba05a-678c-403f-be48-bd22095facd4" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:22:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.network.neutron [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-e9528f4b-d356-4b86-8aa7-feca6b34356e req-87dae0a3-5837-4c35-ada3-1bb5ad33b634 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Received event network-changed-7e0d5e6e-9976-4b42-b655-10b9737e03fc {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-e9528f4b-d356-4b86-8aa7-feca6b34356e req-87dae0a3-5837-4c35-ada3-1bb5ad33b634 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Refreshing instance network info cache due to event network-changed-7e0d5e6e-9976-4b42-b655-10b9737e03fc. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e9528f4b-d356-4b86-8aa7-feca6b34356e req-87dae0a3-5837-4c35-ada3-1bb5ad33b634 service nova] Acquiring lock "refresh_cache-3fcba05a-678c-403f-be48-bd22095facd4" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.network.neutron [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Updating instance_info_cache with network_info: [{"id": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "address": "fa:16:3e:51:fc:b6", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0d5e6e-99", "ovs_interfaceid": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Releasing lock "refresh_cache-3fcba05a-678c-403f-be48-bd22095facd4" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Instance network_info: |[{"id": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "address": "fa:16:3e:51:fc:b6", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0d5e6e-99", "ovs_interfaceid": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e9528f4b-d356-4b86-8aa7-feca6b34356e req-87dae0a3-5837-4c35-ada3-1bb5ad33b634 service nova] Acquired lock "refresh_cache-3fcba05a-678c-403f-be48-bd22095facd4" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.network.neutron [req-e9528f4b-d356-4b86-8aa7-feca6b34356e req-87dae0a3-5837-4c35-ada3-1bb5ad33b634 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Refreshing network info cache for port 7e0d5e6e-9976-4b42-b655-10b9737e03fc {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Start _get_guest_xml network_info=[{"id": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "address": "fa:16:3e:51:fc:b6", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0d5e6e-99", "ovs_interfaceid": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:22:08 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:22:08 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:22:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-637327725',display_name='tempest-VolumesActionsTest-instance-637327725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-637327725',id=28,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa2639b61de64add87f6510f520aa158',ramdisk_id='',reservation_id='r-leb0cic4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-623859009',owner_user_name='tempest-VolumesActionsTest-623859009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:22:06Z,user_data=None,user_id='223a4316eda946d38dd77143a4847484',uuid=3fcba05a-678c-403f-be48-bd22095facd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "address": "fa:16:3e:51:fc:b6", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0d5e6e-99", "ovs_interfaceid": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Converting VIF {"id": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "address": "fa:16:3e:51:fc:b6", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0d5e6e-99", "ovs_interfaceid": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:fc:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e0d5e6e-9976-4b42-b655-10b9737e03fc,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0d5e6e-99') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.objects.instance [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fcba05a-678c-403f-be48-bd22095facd4 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:22:08 user nova-compute[73520]:   <uuid>3fcba05a-678c-403f-be48-bd22095facd4</uuid>
Aug 16 12:22:08 user nova-compute[73520]:   <name>instance-0000001c</name>
Aug 16 12:22:08 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:22:08 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:22:08 user nova-compute[73520]:   <metadata>
Aug 16 12:22:08 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:22:08 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:22:08 user nova-compute[73520]:       <nova:name>tempest-VolumesActionsTest-instance-637327725</nova:name>
Aug 16 12:22:08 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:22:08</nova:creationTime>
Aug 16 12:22:08 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:22:08 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:22:08 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:22:08 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:22:08 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:22:08 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:22:08 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:22:08 user nova-compute[73520]:       <nova:owner>
Aug 16 12:22:08 user nova-compute[73520]:         <nova:user uuid="223a4316eda946d38dd77143a4847484">tempest-VolumesActionsTest-623859009-project-member</nova:user>
Aug 16 12:22:08 user nova-compute[73520]:         <nova:project uuid="fa2639b61de64add87f6510f520aa158">tempest-VolumesActionsTest-623859009</nova:project>
Aug 16 12:22:08 user nova-compute[73520]:       </nova:owner>
Aug 16 12:22:08 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:22:08 user nova-compute[73520]:       <nova:ports>
Aug 16 12:22:08 user nova-compute[73520]:         <nova:port uuid="7e0d5e6e-9976-4b42-b655-10b9737e03fc">
Aug 16 12:22:08 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 12:22:08 user nova-compute[73520]:         </nova:port>
Aug 16 12:22:08 user nova-compute[73520]:       </nova:ports>
Aug 16 12:22:08 user nova-compute[73520]:     </nova:instance>
Aug 16 12:22:08 user nova-compute[73520]:   </metadata>
Aug 16 12:22:08 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:22:08 user nova-compute[73520]:     <system>
Aug 16 12:22:08 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:22:08 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:22:08 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:22:08 user nova-compute[73520]:       <entry name="serial">3fcba05a-678c-403f-be48-bd22095facd4</entry>
Aug 16 12:22:08 user nova-compute[73520]:       <entry name="uuid">3fcba05a-678c-403f-be48-bd22095facd4</entry>
Aug 16 12:22:08 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:22:08 user nova-compute[73520]:     </system>
Aug 16 12:22:08 user nova-compute[73520]:   </sysinfo>
Aug 16 12:22:08 user nova-compute[73520]:   <os>
Aug 16 12:22:08 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:22:08 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:22:08 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:22:08 user nova-compute[73520]:   </os>
Aug 16 12:22:08 user nova-compute[73520]:   <features>
Aug 16 12:22:08 user nova-compute[73520]:     <acpi/>
Aug 16 12:22:08 user nova-compute[73520]:     <apic/>
Aug 16 12:22:08 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:22:08 user nova-compute[73520]:   </features>
Aug 16 12:22:08 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:22:08 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:22:08 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:22:08 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:22:08 user nova-compute[73520]:   </clock>
Aug 16 12:22:08 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:22:08 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:22:08 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:22:08 user nova-compute[73520]:   </cpu>
Aug 16 12:22:08 user nova-compute[73520]:   <devices>
Aug 16 12:22:08 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:22:08 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:22:08 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk"/>
Aug 16 12:22:08 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:22:08 user nova-compute[73520]:     </disk>
Aug 16 12:22:08 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:22:08 user nova-compute[73520]:       <mac address="fa:16:3e:51:fc:b6"/>
Aug 16 12:22:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:22:08 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:22:08 user nova-compute[73520]:       <target dev="tap7e0d5e6e-99"/>
Aug 16 12:22:08 user nova-compute[73520]:     </interface>
Aug 16 12:22:08 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:22:08 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/console.log" append="off"/>
Aug 16 12:22:08 user nova-compute[73520]:     </serial>
Aug 16 12:22:08 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:22:08 user nova-compute[73520]:     <video>
Aug 16 12:22:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:22:08 user nova-compute[73520]:     </video>
Aug 16 12:22:08 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:22:08 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:22:08 user nova-compute[73520]:     </rng>
Aug 16 12:22:08 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:22:08 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:22:08 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:22:08 user nova-compute[73520]:     </memballoon>
Aug 16 12:22:08 user nova-compute[73520]:   </devices>
Aug 16 12:22:08 user nova-compute[73520]: </domain>
Aug 16 12:22:08 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:22:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-637327725',display_name='tempest-VolumesActionsTest-instance-637327725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-637327725',id=28,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa2639b61de64add87f6510f520aa158',ramdisk_id='',reservation_id='r-leb0cic4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-623859009',owner_user_name='tempest-VolumesActionsTest-623859009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:22:06Z,user_data=None,user_id='223a4316eda946d38dd77143a4847484',uuid=3fcba05a-678c-403f-be48-bd22095facd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "address": "fa:16:3e:51:fc:b6", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0d5e6e-99", "ovs_interfaceid": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Converting VIF {"id": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "address": "fa:16:3e:51:fc:b6", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0d5e6e-99", "ovs_interfaceid": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:fc:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e0d5e6e-9976-4b42-b655-10b9737e03fc,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0d5e6e-99') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_vif [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:fc:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e0d5e6e-9976-4b42-b655-10b9737e03fc,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0d5e6e-99') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e0d5e6e-99, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e0d5e6e-99, col_values=(('external_ids', {'iface-id': '7e0d5e6e-9976-4b42-b655-10b9737e03fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:fc:b6', 'vm-uuid': '3fcba05a-678c-403f-be48-bd22095facd4'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:08 user nova-compute[73520]: INFO os_vif [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:fc:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e0d5e6e-9976-4b42-b655-10b9737e03fc,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0d5e6e-99')
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] No VIF found with MAC fa:16:3e:51:fc:b6, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgEabRie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:22:08 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:22:08 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:22:08 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a33cc5-0c5f-44b9-8c04-a883efd96169]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:22:08 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b6f2a5-9d10-48b0-8565-af9fc6f53e7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899] added
Aug 16 12:22:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[86393274-c7a0-4005-a3db-fb1c0019e077]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef656fec-1cc5-466e-afea-5aa1d42b944e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DgEabRie {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DgEabRie" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6bea09-889e-4863-8843-19a0974f78de]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DgEabRie'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[daef3a26-d609-431b-b5ae-11effe95c64f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[addf8be8-6235-45b0-84bf-6f241dfc4a79]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:08 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:08 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2288ab93-6df1-42c6-b053-d31ba5980f2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899, portal: 172.16.0.220,3260]
Aug 16 12:22:08 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899, portal: 172.16.0.220,3260] successful.
Aug 16 12:22:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69aaf31-02dc-45a6-92ae-558f2916c77b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ab24df-1860-44ce-bfd9-bf13cc0d0ce6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:08 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:08 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:22:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:08 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:08 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:22:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[57042a16-231c-4b55-9989-529e143d8b46]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:22:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-e9528f4b-d356-4b86-8aa7-feca6b34356e req-87dae0a3-5837-4c35-ada3-1bb5ad33b634 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Updated VIF entry in instance network info cache for port 7e0d5e6e-9976-4b42-b655-10b9737e03fc. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:22:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-e9528f4b-d356-4b86-8aa7-feca6b34356e req-87dae0a3-5837-4c35-ada3-1bb5ad33b634 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Updating instance_info_cache with network_info: [{"id": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "address": "fa:16:3e:51:fc:b6", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0d5e6e-99", "ovs_interfaceid": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:22:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e9528f4b-d356-4b86-8aa7-feca6b34356e req-87dae0a3-5837-4c35-ada3-1bb5ad33b634 service nova] Releasing lock "refresh_cache-3fcba05a-678c-403f-be48-bd22095facd4" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:22:09 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:22:09 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgEabRie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:22:09 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:22:09 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23066636661643837', 'path': '/dev/sdd'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:22:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066636661643837', 'path': '/dev/sdd'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:22:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:09 user nova-compute[73520]: DEBUG nova.objects.instance [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lazy-loading 'flavor' on Instance uuid 9ab085c8-d666-4525-bee5-d61aada89a7a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:22:10 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:22:10 user nova-compute[73520]:   <source dev="/dev/sdd"/>
Aug 16 12:22:10 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:22:10 user nova-compute[73520]:   <serial>83583c58-4e44-4aee-85a7-a6f5f86ed899</serial>
Aug 16 12:22:10 user nova-compute[73520]: </disk>
Aug 16 12:22:10 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-f72477ba-5a1b-4a3a-bc4e-4ae23a2554fb req-192c1fad-33f8-4466-afd7-c0fba9cddb30 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Received event network-vif-plugged-7e0d5e6e-9976-4b42-b655-10b9737e03fc {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f72477ba-5a1b-4a3a-bc4e-4ae23a2554fb req-192c1fad-33f8-4466-afd7-c0fba9cddb30 service nova] Acquiring lock "3fcba05a-678c-403f-be48-bd22095facd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f72477ba-5a1b-4a3a-bc4e-4ae23a2554fb req-192c1fad-33f8-4466-afd7-c0fba9cddb30 service nova] Lock "3fcba05a-678c-403f-be48-bd22095facd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f72477ba-5a1b-4a3a-bc4e-4ae23a2554fb req-192c1fad-33f8-4466-afd7-c0fba9cddb30 service nova] Lock "3fcba05a-678c-403f-be48-bd22095facd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-f72477ba-5a1b-4a3a-bc4e-4ae23a2554fb req-192c1fad-33f8-4466-afd7-c0fba9cddb30 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] No waiting events found dispatching network-vif-plugged-7e0d5e6e-9976-4b42-b655-10b9737e03fc {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:10 user nova-compute[73520]: WARNING nova.compute.manager [req-f72477ba-5a1b-4a3a-bc4e-4ae23a2554fb req-192c1fad-33f8-4466-afd7-c0fba9cddb30 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Received unexpected event network-vif-plugged-7e0d5e6e-9976-4b42-b655-10b9737e03fc for instance with vm_state building and task_state spawning.
Aug 16 12:22:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] No VIF found with MAC fa:16:3e:ac:d9:71, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:22:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5a10fbb4-b1a5-499a-a0a2-9477dedb53d9 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.996s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-ca0852da-3ed7-4e36-a0f0-31ac44c5a690 req-1a8554b9-dff4-463d-b2e5-6c1d7ca2fde1 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Received event network-vif-plugged-7e0d5e6e-9976-4b42-b655-10b9737e03fc {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ca0852da-3ed7-4e36-a0f0-31ac44c5a690 req-1a8554b9-dff4-463d-b2e5-6c1d7ca2fde1 service nova] Acquiring lock "3fcba05a-678c-403f-be48-bd22095facd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ca0852da-3ed7-4e36-a0f0-31ac44c5a690 req-1a8554b9-dff4-463d-b2e5-6c1d7ca2fde1 service nova] Lock "3fcba05a-678c-403f-be48-bd22095facd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ca0852da-3ed7-4e36-a0f0-31ac44c5a690 req-1a8554b9-dff4-463d-b2e5-6c1d7ca2fde1 service nova] Lock "3fcba05a-678c-403f-be48-bd22095facd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-ca0852da-3ed7-4e36-a0f0-31ac44c5a690 req-1a8554b9-dff4-463d-b2e5-6c1d7ca2fde1 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] No waiting events found dispatching network-vif-plugged-7e0d5e6e-9976-4b42-b655-10b9737e03fc {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:12 user nova-compute[73520]: WARNING nova.compute.manager [req-ca0852da-3ed7-4e36-a0f0-31ac44c5a690 req-1a8554b9-dff4-463d-b2e5-6c1d7ca2fde1 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Received unexpected event network-vif-plugged-7e0d5e6e-9976-4b42-b655-10b9737e03fc for instance with vm_state building and task_state spawning.
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188532.539054, 3fcba05a-678c-403f-be48-bd22095facd4 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:22:12 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] VM Resumed (Lifecycle Event)
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:22:12 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Instance spawned successfully.
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:12 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188532.5425608, 3fcba05a-678c-403f-be48-bd22095facd4 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:22:12 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] VM Started (Lifecycle Event)
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:22:12 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:22:12 user nova-compute[73520]: INFO nova.compute.manager [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Took 6.22 seconds to spawn the instance on the hypervisor.
Aug 16 12:22:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:22:12 user nova-compute[73520]: INFO nova.compute.manager [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Took 7.39 seconds to build instance.
Aug 16 12:22:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-947daeec-4785-42af-9be4-a28885c9449d tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "3fcba05a-678c-403f-be48-bd22095facd4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.510s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "9ab085c8-d666-4525-bee5-d61aada89a7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG nova.objects.instance [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lazy-loading 'flavor' on Instance uuid 9ab085c8-d666-4525-bee5-d61aada89a7a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:22:15 user nova-compute[73520]: INFO nova.compute.claims [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Claim successful on node user
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "9ab085c8-d666-4525-bee5-d61aada89a7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:15 user nova-compute[73520]: INFO nova.compute.manager [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Attaching volume 74053ee6-bb19-4419-ba80-dc59e381e353 to /dev/vdc
Aug 16 12:22:15 user nova-compute[73520]: DEBUG os_brick.utils [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab055267-1ff7-4806-8cfe-77049072b2e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bb0c7e-a925-41c8-b1bd-e4a9f4ebbfb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dce0f9-bb3c-41da-a58c-be9661c7762e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a3744f-3dc8-40d2-8ba4-314bd034ec39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:22:15 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:22:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9358ce-3a84-4c17-8ddb-954f7b58d006]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG os_brick.utils [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:22:15 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Updating existing volume attachment record: 8bd4b812-b4dd-4815-ae07-060da70cd7a1 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.665s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:22:16 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:22:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:22:16 user nova-compute[73520]: INFO nova.virt.block_device [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Booting with volume e7018bd3-2899-481b-8ae4-e08c034c8cd3 at /dev/vda
Aug 16 12:22:16 user nova-compute[73520]: DEBUG nova.policy [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17ed1823b0de433ab523470e235fdd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a693cd27934644be8e64731417c66783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG os_brick.utils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efc43a5-9131-4444-a546-813c1739bb16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[742adf74-c383-4fa7-964b-f1f8b689a267]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbf9023-d2b0-4b79-973b-f7e84e098d39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[294a3e3b-a0a0-4af4-8528-0a819bb98567]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:22:16 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:22:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdeb723-8238-4792-9bd3-a15815adfaa0]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG os_brick.utils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:22:16 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Updating existing volume attachment record: f97432a7-e09f-4921-9ee9-ef3d555f89a2 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:22:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Successfully created port: 27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:22:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:18 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Successfully updated port: 27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:22:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "refresh_cache-e0c2b937-066a-490f-a2a2-57ae3dfe814b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:22:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquired lock "refresh_cache-e0c2b937-066a-490f-a2a2-57ae3dfe814b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:22:18 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:22:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-368cf9c6-3b03-41f7-aa6b-a30c95aa1d3a req-f41caa1f-4d2f-4e30-a5c6-9a86ba18ae08 service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Received event network-changed-27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-368cf9c6-3b03-41f7-aa6b-a30c95aa1d3a req-f41caa1f-4d2f-4e30-a5c6-9a86ba18ae08 service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Refreshing instance network info cache due to event network-changed-27d75b6f-6479-4d50-9c9e-f0dc8800b660. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:22:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-368cf9c6-3b03-41f7-aa6b-a30c95aa1d3a req-f41caa1f-4d2f-4e30-a5c6-9a86ba18ae08 service nova] Acquiring lock "refresh_cache-e0c2b937-066a-490f-a2a2-57ae3dfe814b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:22:18 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:19 user nova-compute[73520]: INFO nova.compute.manager [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Terminating instance
Aug 16 12:22:19 user nova-compute[73520]: DEBUG nova.compute.manager [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Updating instance_info_cache with network_info: [{"id": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "address": "fa:16:3e:b6:90:a6", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d75b6f-64", "ovs_interfaceid": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Releasing lock "refresh_cache-e0c2b937-066a-490f-a2a2-57ae3dfe814b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Instance network_info: |[{"id": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "address": "fa:16:3e:b6:90:a6", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d75b6f-64", "ovs_interfaceid": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-368cf9c6-3b03-41f7-aa6b-a30c95aa1d3a req-f41caa1f-4d2f-4e30-a5c6-9a86ba18ae08 service nova] Acquired lock "refresh_cache-e0c2b937-066a-490f-a2a2-57ae3dfe814b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG nova.network.neutron [req-368cf9c6-3b03-41f7-aa6b-a30c95aa1d3a req-f41caa1f-4d2f-4e30-a5c6-9a86ba18ae08 service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Refreshing network info cache for port 27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-b2188039-b2a9-40d2-a05d-c8e10f18d038 req-4cb1978c-12dd-4ce4-b16c-de371a2232d6 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received event network-vif-unplugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b2188039-b2a9-40d2-a05d-c8e10f18d038 req-4cb1978c-12dd-4ce4-b16c-de371a2232d6 service nova] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b2188039-b2a9-40d2-a05d-c8e10f18d038 req-4cb1978c-12dd-4ce4-b16c-de371a2232d6 service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b2188039-b2a9-40d2-a05d-c8e10f18d038 req-4cb1978c-12dd-4ce4-b16c-de371a2232d6 service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-b2188039-b2a9-40d2-a05d-c8e10f18d038 req-4cb1978c-12dd-4ce4-b16c-de371a2232d6 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] No waiting events found dispatching network-vif-unplugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-b2188039-b2a9-40d2-a05d-c8e10f18d038 req-4cb1978c-12dd-4ce4-b16c-de371a2232d6 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received event network-vif-unplugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:20 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Instance destroyed successfully.
Aug 16 12:22:20 user nova-compute[73520]: DEBUG nova.objects.instance [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'resources' on Instance uuid 5bc17e5d-3ae1-474d-bd49-71c60f3e46be {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1602865874',display_name='tempest-ServerActionsTestOtherA-server-326484734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1602865874',id=15,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWDmy7Y42O8TTQkPPhvFapOqey2yzr7+HunIIo/9lzfe8rKUqepoW4Do3+MfNrt5xHtu6/gJraSlGY+a2w8Nv7CvDCfHvcSHnTbLC47JDVntO2l274nBETm3y7rR4CR0A==',key_name='tempest-keypair-305970178',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:19:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-lgydxk2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:19:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=5bc17e5d-3ae1-474d-bd49-71c60f3e46be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:22:20 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "address": "fa:16:3e:38:2a:c6", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a8f0eb-62", "ovs_interfaceid": "27a8f0eb-6244-4a6c-81e7-977795d5ea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:22:20 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:22:20 user nova-compute[73520]: DEBUG os_vif [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:22:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27a8f0eb-62, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:20 user nova-compute[73520]: INFO os_vif [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:2a:c6,bridge_name='br-int',has_traffic_filtering=True,id=27a8f0eb-6244-4a6c-81e7-977795d5ea41,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a8f0eb-62')
Aug 16 12:22:20 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Deleting instance files /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be_del
Aug 16 12:22:20 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Deletion of /opt/stack/data/nova/instances/5bc17e5d-3ae1-474d-bd49-71c60f3e46be_del complete
Aug 16 12:22:20 user nova-compute[73520]: DEBUG nova.network.neutron [req-368cf9c6-3b03-41f7-aa6b-a30c95aa1d3a req-f41caa1f-4d2f-4e30-a5c6-9a86ba18ae08 service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Updated VIF entry in instance network info cache for port 27d75b6f-6479-4d50-9c9e-f0dc8800b660. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:22:20 user nova-compute[73520]: DEBUG nova.network.neutron [req-368cf9c6-3b03-41f7-aa6b-a30c95aa1d3a req-f41caa1f-4d2f-4e30-a5c6-9a86ba18ae08 service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Updating instance_info_cache with network_info: [{"id": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "address": "fa:16:3e:b6:90:a6", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d75b6f-64", "ovs_interfaceid": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:22:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-368cf9c6-3b03-41f7-aa6b-a30c95aa1d3a req-f41caa1f-4d2f-4e30-a5c6-9a86ba18ae08 service nova] Releasing lock "refresh_cache-e0c2b937-066a-490f-a2a2-57ae3dfe814b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:22:20 user nova-compute[73520]: INFO nova.compute.manager [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 12:22:20 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:22:20 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:22:20 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:22:21 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:22:21 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Took 1.17 seconds to deallocate network for instance.
Aug 16 12:22:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-81232593-8e9d-4ba9-9aa5-c02e4ddf9ff7 req-9e6a5a1d-7987-4832-a1f9-c25a59734e35 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received event network-vif-deleted-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-b3641710-571c-4c10-bd9e-e6432e751f19 req-6c80b8f2-52dc-413a-8d11-b9f59e9041b5 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received event network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b3641710-571c-4c10-bd9e-e6432e751f19 req-6c80b8f2-52dc-413a-8d11-b9f59e9041b5 service nova] Acquiring lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b3641710-571c-4c10-bd9e-e6432e751f19 req-6c80b8f2-52dc-413a-8d11-b9f59e9041b5 service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b3641710-571c-4c10-bd9e-e6432e751f19 req-6c80b8f2-52dc-413a-8d11-b9f59e9041b5 service nova] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-b3641710-571c-4c10-bd9e-e6432e751f19 req-6c80b8f2-52dc-413a-8d11-b9f59e9041b5 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] No waiting events found dispatching network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:21 user nova-compute[73520]: WARNING nova.compute.manager [req-b3641710-571c-4c10-bd9e-e6432e751f19 req-6c80b8f2-52dc-413a-8d11-b9f59e9041b5 service nova] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Received unexpected event network-vif-plugged-27a8f0eb-6244-4a6c-81e7-977795d5ea41 for instance with vm_state deleted and task_state None.
Aug 16 12:22:21 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:22:21 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:22:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:21 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Deleted allocations for instance 5bc17e5d-3ae1-474d-bd49-71c60f3e46be
Aug 16 12:22:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-50a14961-4dec-4471-b84a-4d5183137ffb tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "5bc17e5d-3ae1-474d-bd49-71c60f3e46be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.769s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UouRjzSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:22:27 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:22:27 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:22:27 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[161510e9-fef7-4306-996c-ca7ad974dd5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:22:27 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2814b1be-e8e4-4e1c-9fd8-720a2abae643]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353] added
Aug 16 12:22:27 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b847e00-1076-498a-95c1-aefab3baab95]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a354d96-ae2f-4aff-bb9a-5a7b471a3abe]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UouRjzSZ {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UouRjzSZ" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82c4f31-4516-43c6-8109-4fe83c4ed845]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UouRjzSZ'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa408fe-d450-4445-91c0-9ea47b7c7443]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[961210a5-bce8-4d35-a759-8514ee21a60d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:27 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:27 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:22:27 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:27 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:27 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:22:27 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[356abd94-d15c-459e-864e-235d14bf23b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353, portal: 172.16.0.220,3260]
Aug 16 12:22:27 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353, portal: 172.16.0.220,3260] successful.
Aug 16 12:22:27 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2ca948-81bd-4c06-84d8-8624c926ee31]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b702f8-94e5-40f5-844b-b403730efb72]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:27 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:27 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:22:27 user nova-compute[73520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 (non-flash)
Aug 16 12:22:27 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:27 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:27 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:22:27 user nova-compute[73520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 (non-flash)
Aug 16 12:22:27 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d539891-b863-4646-8327-c320c879ad19]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UouRjzSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:22:27 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Creating image(s)
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Ensure instance console log exists: /opt/stack/data/nova/instances/e0c2b937-066a-490f-a2a2-57ae3dfe814b/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Start _get_guest_xml network_info=[{"id": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "address": "fa:16:3e:b6:90:a6", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d75b6f-64", "ovs_interfaceid": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoJChYEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e0c2b937-066a-490f-a2a2-57ae3dfe814b', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7018bd3-2899-481b-8ae4-e08c034c8cd3', 'serial': 'e7018bd3-2899-481b-8ae4-e08c034c8cd3'}, 'attachment_id': 'f97432a7-e09f-4921-9ee9-ef3d555f89a2', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:22:27 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:22:27 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoJChYEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:22:27 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:22:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26334633030363061', 'path': '/dev/sde'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334633030363061', 'path': '/dev/sde'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.704s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:22:28 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:22:28 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG nova.objects.instance [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lazy-loading 'flavor' on Instance uuid 9ab085c8-d666-4525-bee5-d61aada89a7a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cea955-a1c6-46eb-b727-9bc5e5980e33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:22:28 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:22:28 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:22:28 user nova-compute[73520]:   <source dev="/dev/sde"/>
Aug 16 12:22:28 user nova-compute[73520]:   <target dev="vdc" bus="virtio"/>
Aug 16 12:22:28 user nova-compute[73520]:   <serial>74053ee6-bb19-4419-ba80-dc59e381e353</serial>
Aug 16 12:22:28 user nova-compute[73520]: </disk>
Aug 16 12:22:28 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55ef7db-05dc-46bc-a650-66af901a4077]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3] added
Aug 16 12:22:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c785ef9-5c29-4b31-b247-885184929b5d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2edc9ec-778c-44f4-9286-01bf3420b28b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yoJChYEj {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yoJChYEj" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cc551c-bccc-4c22-8315-2a8f75fd4367]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yoJChYEj'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b954e20c-d60d-4853-8fcb-3504ac38faa0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ee44af-5307-42e7-b9f8-1554ab4a2839]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58b0ba7-a0b4-454b-9803-be860b343153]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3, portal: 172.16.0.220,3260]
Aug 16 12:22:28 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3, portal: 172.16.0.220,3260] successful.
Aug 16 12:22:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2222ba81-4c28-45c1-92c4-065cd50a2f32]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c4b13b-abf8-4c20-81bb-8298680aec12]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:22:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff78bbb-fc5d-489a-a2a5-f3282d09c0ae]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:22:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoJChYEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] No VIF found with MAC fa:16:3e:ac:d9:71, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8fde2b48-fb0a-42f2-95ca-f4f89f772eab tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.557s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== connect_volume: return (2051ms) {'type': 'block', 'scsi_wwn': '26465346337303230', 'path': '/dev/sdf'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465346337303230', 'path': '/dev/sdf'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1596224209',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1596224209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1596224209',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNx+AhdqigGLgUGXGkWJz6SuhZ8eHje8bxVk+mxSZiRI72VYrb8ZQ/h21nZd/H1syRq0NFiONgN7tgleOltqn7Jhw3aKtW8zwxNq9jOb/OFRVKCnSTOrHT/ODHuMLXWTpA==',key_name='tempest-keypair-1304610420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-44ozn0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ed1823b0de433ab523470e235fdd72',uuid=e0c2b937-066a-490f-a2a2-57ae3dfe814b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "address": "fa:16:3e:b6:90:a6", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d75b6f-64", "ovs_interfaceid": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "address": "fa:16:3e:b6:90:a6", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d75b6f-64", "ovs_interfaceid": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:90:a6,bridge_name='br-int',has_traffic_filtering=True,id=27d75b6f-6479-4d50-9c9e-f0dc8800b660,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d75b6f-64') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lazy-loading 'pci_devices' on Instance uuid e0c2b937-066a-490f-a2a2-57ae3dfe814b {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:22:29 user nova-compute[73520]:   <uuid>e0c2b937-066a-490f-a2a2-57ae3dfe814b</uuid>
Aug 16 12:22:29 user nova-compute[73520]:   <name>instance-0000001d</name>
Aug 16 12:22:29 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:22:29 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:22:29 user nova-compute[73520]:   <metadata>
Aug 16 12:22:29 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:22:29 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:22:29 user nova-compute[73520]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1596224209</nova:name>
Aug 16 12:22:29 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:22:27</nova:creationTime>
Aug 16 12:22:29 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:22:29 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:22:29 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:22:29 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:22:29 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:22:29 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:22:29 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:22:29 user nova-compute[73520]:       <nova:owner>
Aug 16 12:22:29 user nova-compute[73520]:         <nova:user uuid="17ed1823b0de433ab523470e235fdd72">tempest-TestVolumeBootPattern-496055159-project-member</nova:user>
Aug 16 12:22:29 user nova-compute[73520]:         <nova:project uuid="a693cd27934644be8e64731417c66783">tempest-TestVolumeBootPattern-496055159</nova:project>
Aug 16 12:22:29 user nova-compute[73520]:       </nova:owner>
Aug 16 12:22:29 user nova-compute[73520]:       <nova:ports>
Aug 16 12:22:29 user nova-compute[73520]:         <nova:port uuid="27d75b6f-6479-4d50-9c9e-f0dc8800b660">
Aug 16 12:22:29 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 12:22:29 user nova-compute[73520]:         </nova:port>
Aug 16 12:22:29 user nova-compute[73520]:       </nova:ports>
Aug 16 12:22:29 user nova-compute[73520]:     </nova:instance>
Aug 16 12:22:29 user nova-compute[73520]:   </metadata>
Aug 16 12:22:29 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:22:29 user nova-compute[73520]:     <system>
Aug 16 12:22:29 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:22:29 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:22:29 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:22:29 user nova-compute[73520]:       <entry name="serial">e0c2b937-066a-490f-a2a2-57ae3dfe814b</entry>
Aug 16 12:22:29 user nova-compute[73520]:       <entry name="uuid">e0c2b937-066a-490f-a2a2-57ae3dfe814b</entry>
Aug 16 12:22:29 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:22:29 user nova-compute[73520]:     </system>
Aug 16 12:22:29 user nova-compute[73520]:   </sysinfo>
Aug 16 12:22:29 user nova-compute[73520]:   <os>
Aug 16 12:22:29 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:22:29 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:22:29 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:22:29 user nova-compute[73520]:   </os>
Aug 16 12:22:29 user nova-compute[73520]:   <features>
Aug 16 12:22:29 user nova-compute[73520]:     <acpi/>
Aug 16 12:22:29 user nova-compute[73520]:     <apic/>
Aug 16 12:22:29 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:22:29 user nova-compute[73520]:   </features>
Aug 16 12:22:29 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:22:29 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:22:29 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:22:29 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:22:29 user nova-compute[73520]:   </clock>
Aug 16 12:22:29 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:22:29 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:22:29 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:22:29 user nova-compute[73520]:   </cpu>
Aug 16 12:22:29 user nova-compute[73520]:   <devices>
Aug 16 12:22:29 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:22:29 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:22:29 user nova-compute[73520]:       <source dev="/dev/sdf"/>
Aug 16 12:22:29 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:22:29 user nova-compute[73520]:       <serial>e7018bd3-2899-481b-8ae4-e08c034c8cd3</serial>
Aug 16 12:22:29 user nova-compute[73520]:     </disk>
Aug 16 12:22:29 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:22:29 user nova-compute[73520]:       <mac address="fa:16:3e:b6:90:a6"/>
Aug 16 12:22:29 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:22:29 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:22:29 user nova-compute[73520]:       <target dev="tap27d75b6f-64"/>
Aug 16 12:22:29 user nova-compute[73520]:     </interface>
Aug 16 12:22:29 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:22:29 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/e0c2b937-066a-490f-a2a2-57ae3dfe814b/console.log" append="off"/>
Aug 16 12:22:29 user nova-compute[73520]:     </serial>
Aug 16 12:22:29 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:22:29 user nova-compute[73520]:     <video>
Aug 16 12:22:29 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:22:29 user nova-compute[73520]:     </video>
Aug 16 12:22:29 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:22:29 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:22:29 user nova-compute[73520]:     </rng>
Aug 16 12:22:29 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:22:29 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:22:29 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:22:29 user nova-compute[73520]:     </memballoon>
Aug 16 12:22:29 user nova-compute[73520]:   </devices>
Aug 16 12:22:29 user nova-compute[73520]: </domain>
Aug 16 12:22:29 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1596224209',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1596224209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1596224209',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNx+AhdqigGLgUGXGkWJz6SuhZ8eHje8bxVk+mxSZiRI72VYrb8ZQ/h21nZd/H1syRq0NFiONgN7tgleOltqn7Jhw3aKtW8zwxNq9jOb/OFRVKCnSTOrHT/ODHuMLXWTpA==',key_name='tempest-keypair-1304610420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-44ozn0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ed1823b0de433ab523470e235fdd72',uuid=e0c2b937-066a-490f-a2a2-57ae3dfe814b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "address": "fa:16:3e:b6:90:a6", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d75b6f-64", "ovs_interfaceid": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "address": "fa:16:3e:b6:90:a6", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d75b6f-64", "ovs_interfaceid": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:90:a6,bridge_name='br-int',has_traffic_filtering=True,id=27d75b6f-6479-4d50-9c9e-f0dc8800b660,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d75b6f-64') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG os_vif [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:90:a6,bridge_name='br-int',has_traffic_filtering=True,id=27d75b6f-6479-4d50-9c9e-f0dc8800b660,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d75b6f-64') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "9ab085c8-d666-4525-bee5-d61aada89a7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27d75b6f-64, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27d75b6f-64, col_values=(('external_ids', {'iface-id': '27d75b6f-6479-4d50-9c9e-f0dc8800b660', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:90:a6', 'vm-uuid': 'e0c2b937-066a-490f-a2a2-57ae3dfe814b'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:22:29 user nova-compute[73520]: INFO nova.compute.manager [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Detaching volume 74053ee6-bb19-4419-ba80-dc59e381e353
Aug 16 12:22:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:29 user nova-compute[73520]: INFO os_vif [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:90:a6,bridge_name='br-int',has_traffic_filtering=True,id=27d75b6f-6479-4d50-9c9e-f0dc8800b660,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d75b6f-64')
Aug 16 12:22:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] No VIF found with MAC fa:16:3e:b6:90:a6, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:22:30 user nova-compute[73520]: INFO nova.virt.block_device [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Attempting to driver detach volume 74053ee6-bb19-4419-ba80-dc59e381e353 from mountpoint /dev/vdc
Aug 16 12:22:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Attempting to detach device vdc from instance 9ab085c8-d666-4525-bee5-d61aada89a7a from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:22:30 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:22:30 user nova-compute[73520]:   <source dev="/dev/sde"/>
Aug 16 12:22:30 user nova-compute[73520]:   <target dev="vdc" bus="virtio"/>
Aug 16 12:22:30 user nova-compute[73520]:   <serial>74053ee6-bb19-4419-ba80-dc59e381e353</serial>
Aug 16 12:22:30 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 12:22:30 user nova-compute[73520]: </disk>
Aug 16 12:22:30 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:22:30 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Successfully detached device vdc from instance 9ab085c8-d666-4525-bee5-d61aada89a7a from the persistent domain config.
Aug 16 12:22:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9ab085c8-d666-4525-bee5-d61aada89a7a from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:22:30 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:22:30 user nova-compute[73520]:   <source dev="/dev/sde"/>
Aug 16 12:22:30 user nova-compute[73520]:   <target dev="vdc" bus="virtio"/>
Aug 16 12:22:30 user nova-compute[73520]:   <serial>74053ee6-bb19-4419-ba80-dc59e381e353</serial>
Aug 16 12:22:30 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 12:22:30 user nova-compute[73520]: </disk>
Aug 16 12:22:30 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188550.6416516, 9ab085c8-d666-4525-bee5-d61aada89a7a => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9ab085c8-d666-4525-bee5-d61aada89a7a {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:22:30 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Successfully detached device vdc from instance 9ab085c8-d666-4525-bee5-d61aada89a7a from the live domain config.
Aug 16 12:22:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UouRjzSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:22:30 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e3d668-2136-4642-ba3c-9909d72c8440]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61f0d2c-3745-425c-92c8-1fc45d7c42a9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:30 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:30 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:22:30 user nova-compute[73520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 (non-flash)
Aug 16 12:22:30 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:22:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:22:30 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:22:30 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:22:30 user nova-compute[73520]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 (non-flash)
Aug 16 12:22:30 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:22:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c663a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353'): ({'sde'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Removing single pathed devices sde {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cad222-92cc-4f91-919a-da2942923141]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[057e429c-666a-4dc9-8a28-a0a6e064f263]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Flushing IO for device /dev/sde {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[61444b96-0cd9-4b0b-be2f-1a2af419508e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7d18f7-8510-4aa6-840f-1c456b3524f7]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ddfed2-18bd-46a9-beeb-c71b35009782]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[13203f0f-f83a-4687-980e-27df8f75c80f]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353, portal: 172.16.0.220,3260]
Aug 16 12:22:30 user nova-compute[73520]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353, portal: 172.16.0.220,3260] successful.
Aug 16 12:22:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74053ee6-bb19-4419-ba80-dc59e381e353 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2721c462-f4f8-497f-b54f-6d3ec0434f16]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] <== disconnect_volume: return (326ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:22:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:22:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:31 user nova-compute[73520]: DEBUG nova.objects.instance [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lazy-loading 'flavor' on Instance uuid 9ab085c8-d666-4525-bee5-d61aada89a7a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3606bc6c-9e7a-465a-a9cb-4755948ac19d tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.889s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-360e9462-abc4-45c0-b6a1-6120492df4a9 req-5f6cc08b-9307-4c77-8323-88f1856f2c0d service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Received event network-vif-plugged-27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-360e9462-abc4-45c0-b6a1-6120492df4a9 req-5f6cc08b-9307-4c77-8323-88f1856f2c0d service nova] Acquiring lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-360e9462-abc4-45c0-b6a1-6120492df4a9 req-5f6cc08b-9307-4c77-8323-88f1856f2c0d service nova] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-360e9462-abc4-45c0-b6a1-6120492df4a9 req-5f6cc08b-9307-4c77-8323-88f1856f2c0d service nova] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-360e9462-abc4-45c0-b6a1-6120492df4a9 req-5f6cc08b-9307-4c77-8323-88f1856f2c0d service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] No waiting events found dispatching network-vif-plugged-27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:31 user nova-compute[73520]: WARNING nova.compute.manager [req-360e9462-abc4-45c0-b6a1-6120492df4a9 req-5f6cc08b-9307-4c77-8323-88f1856f2c0d service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Received unexpected event network-vif-plugged-27d75b6f-6479-4d50-9c9e-f0dc8800b660 for instance with vm_state building and task_state spawning.
Aug 16 12:22:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:32 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188553.793336, e0c2b937-066a-490f-a2a2-57ae3dfe814b => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:22:33 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] VM Resumed (Lifecycle Event)
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:22:33 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Instance spawned successfully.
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:22:33 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188553.7989702, e0c2b937-066a-490f-a2a2-57ae3dfe814b => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:22:33 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] VM Started (Lifecycle Event)
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:22:33 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:22:33 user nova-compute[73520]: INFO nova.compute.manager [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-cbc6157e-55aa-4085-81b0-fe0ff3c6522e req-6aa71f76-1ebf-45d8-aa96-bd9ecfed2947 service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Received event network-vif-plugged-27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cbc6157e-55aa-4085-81b0-fe0ff3c6522e req-6aa71f76-1ebf-45d8-aa96-bd9ecfed2947 service nova] Acquiring lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cbc6157e-55aa-4085-81b0-fe0ff3c6522e req-6aa71f76-1ebf-45d8-aa96-bd9ecfed2947 service nova] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cbc6157e-55aa-4085-81b0-fe0ff3c6522e req-6aa71f76-1ebf-45d8-aa96-bd9ecfed2947 service nova] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-cbc6157e-55aa-4085-81b0-fe0ff3c6522e req-6aa71f76-1ebf-45d8-aa96-bd9ecfed2947 service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] No waiting events found dispatching network-vif-plugged-27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:33 user nova-compute[73520]: WARNING nova.compute.manager [req-cbc6157e-55aa-4085-81b0-fe0ff3c6522e req-6aa71f76-1ebf-45d8-aa96-bd9ecfed2947 service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Received unexpected event network-vif-plugged-27d75b6f-6479-4d50-9c9e-f0dc8800b660 for instance with vm_state building and task_state spawning.
Aug 16 12:22:33 user nova-compute[73520]: INFO nova.compute.manager [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Took 18.62 seconds to build instance.
Aug 16 12:22:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b952ba5b-9f12-462d-8f87-432e0ef40c95 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.755s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:34 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:22:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:22:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-91e479f7-5fc0-46d2-9c02-52175084fbf6" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-91e479f7-5fc0-46d2-9c02-52175084fbf6" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188540.0625954, 5bc17e5d-3ae1-474d-bd49-71c60f3e46be => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:22:35 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] VM Stopped (Lifecycle Event)
Aug 16 12:22:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-8fd0573e-4d90-4d8d-8e3a-6b4c13c48e8e None None] [instance: 5bc17e5d-3ae1-474d-bd49-71c60f3e46be] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Updating instance_info_cache with network_info: [{"id": "2905850b-ae11-4b8f-9f36-8843981fc748", "address": "fa:16:3e:e5:45:a0", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2905850b-ae", "ovs_interfaceid": "2905850b-ae11-4b8f-9f36-8843981fc748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-91e479f7-5fc0-46d2-9c02-52175084fbf6" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:22:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:22:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "70eeda03-767e-4c60-b535-9b250b63513b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "70eeda03-767e-4c60-b535-9b250b63513b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "70eeda03-767e-4c60-b535-9b250b63513b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "70eeda03-767e-4c60-b535-9b250b63513b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "70eeda03-767e-4c60-b535-9b250b63513b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:38 user nova-compute[73520]: INFO nova.compute.manager [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Terminating instance
Aug 16 12:22:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-32906bf9-2eff-46a6-9b13-c9388a23c0da req-6d8a5f84-6081-486c-9e78-4e7f8dd29a40 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Received event network-vif-unplugged-fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32906bf9-2eff-46a6-9b13-c9388a23c0da req-6d8a5f84-6081-486c-9e78-4e7f8dd29a40 service nova] Acquiring lock "70eeda03-767e-4c60-b535-9b250b63513b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32906bf9-2eff-46a6-9b13-c9388a23c0da req-6d8a5f84-6081-486c-9e78-4e7f8dd29a40 service nova] Lock "70eeda03-767e-4c60-b535-9b250b63513b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32906bf9-2eff-46a6-9b13-c9388a23c0da req-6d8a5f84-6081-486c-9e78-4e7f8dd29a40 service nova] Lock "70eeda03-767e-4c60-b535-9b250b63513b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-32906bf9-2eff-46a6-9b13-c9388a23c0da req-6d8a5f84-6081-486c-9e78-4e7f8dd29a40 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] No waiting events found dispatching network-vif-unplugged-fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-32906bf9-2eff-46a6-9b13-c9388a23c0da req-6d8a5f84-6081-486c-9e78-4e7f8dd29a40 service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Received event network-vif-unplugged-fa463141-b9cd-48a7-98ec-d36b007f4f5b for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:22:39 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Instance destroyed successfully.
Aug 16 12:22:39 user nova-compute[73520]: DEBUG nova.objects.instance [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'resources' on Instance uuid 70eeda03-767e-4c60-b535-9b250b63513b {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1622165131',display_name='tempest-AttachVolumeNegativeTest-server-1622165131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1622165131',id=21,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcVBXOJWiflyDxuT+i9xkLqvQGPKdKNI3Z8LN87Nv2wgZlkzI4EZe1cEExZs1byWRLjn2wsQlfsq/ZJUOlnmmWfx8tSoe/3WYVGc5XBNrNGCZ4dbr0+EHx2SGhdbbYPdA==',key_name='tempest-keypair-1539971069',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1059841e2ee04ca4870497a1ec60bcaa',ramdisk_id='',reservation_id='r-aq3tbst7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1618912538',owner_user_name='tempest-AttachVolumeNegativeTest-1618912538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6426c917725745038fdb1d03fec4a2fd',uuid=70eeda03-767e-4c60-b535-9b250b63513b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "address": "fa:16:3e:3c:be:f7", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa463141-b9", "ovs_interfaceid": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converting VIF {"id": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "address": "fa:16:3e:3c:be:f7", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa463141-b9", "ovs_interfaceid": "fa463141-b9cd-48a7-98ec-d36b007f4f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:be:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa463141-b9cd-48a7-98ec-d36b007f4f5b,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa463141-b9') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG os_vif [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:be:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa463141-b9cd-48a7-98ec-d36b007f4f5b,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa463141-b9') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa463141-b9, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:22:39 user nova-compute[73520]: INFO os_vif [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:be:f7,bridge_name='br-int',has_traffic_filtering=True,id=fa463141-b9cd-48a7-98ec-d36b007f4f5b,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa463141-b9')
Aug 16 12:22:39 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Deleting instance files /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b_del
Aug 16 12:22:39 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Deletion of /opt/stack/data/nova/instances/70eeda03-767e-4c60-b535-9b250b63513b_del complete
Aug 16 12:22:39 user nova-compute[73520]: INFO nova.compute.manager [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:22:40 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:22:40 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=6980MB free_disk=25.361251831054688GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:22:40 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Took 1.15 seconds to deallocate network for instance.
Aug 16 12:22:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 91e479f7-5fc0-46d2-9c02-52175084fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 70eeda03-767e-4c60-b535-9b250b63513b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 9ab085c8-d666-4525-bee5-d61aada89a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance e3236316-dada-4aee-a210-6d9e9950c166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance b58731e0-399d-4f8d-84b8-af12a46cf87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 3fcba05a-678c-403f-be48-bd22095facd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance e0c2b937-066a-490f-a2a2-57ae3dfe814b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:22:40 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:22:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-b423dc68-c531-47d1-984b-a90c3a088ad8 req-55c01c4b-8d97-4127-825d-d9f329e30c3d service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Received event network-vif-plugged-fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b423dc68-c531-47d1-984b-a90c3a088ad8 req-55c01c4b-8d97-4127-825d-d9f329e30c3d service nova] Acquiring lock "70eeda03-767e-4c60-b535-9b250b63513b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b423dc68-c531-47d1-984b-a90c3a088ad8 req-55c01c4b-8d97-4127-825d-d9f329e30c3d service nova] Lock "70eeda03-767e-4c60-b535-9b250b63513b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b423dc68-c531-47d1-984b-a90c3a088ad8 req-55c01c4b-8d97-4127-825d-d9f329e30c3d service nova] Lock "70eeda03-767e-4c60-b535-9b250b63513b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-b423dc68-c531-47d1-984b-a90c3a088ad8 req-55c01c4b-8d97-4127-825d-d9f329e30c3d service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] No waiting events found dispatching network-vif-plugged-fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:41 user nova-compute[73520]: WARNING nova.compute.manager [req-b423dc68-c531-47d1-984b-a90c3a088ad8 req-55c01c4b-8d97-4127-825d-d9f329e30c3d service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Received unexpected event network-vif-plugged-fa463141-b9cd-48a7-98ec-d36b007f4f5b for instance with vm_state deleted and task_state None.
Aug 16 12:22:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-b423dc68-c531-47d1-984b-a90c3a088ad8 req-55c01c4b-8d97-4127-825d-d9f329e30c3d service nova] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Received event network-vif-deleted-fa463141-b9cd-48a7-98ec-d36b007f4f5b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:41 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:22:41 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:22:41 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:22:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.529s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:41 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:22:41 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:22:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:41 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Deleted allocations for instance 70eeda03-767e-4c60-b535-9b250b63513b
Aug 16 12:22:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-09fdb38f-b376-462e-81fe-1f578d1bcfea tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "70eeda03-767e-4c60-b535-9b250b63513b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.228s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:22:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:22:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:22:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:22:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-1e626483-2d2f-4cfc-919d-ea0c72fab5ff req-67478480-342d-42b4-ab38-b8d89d569554 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-changed-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-1e626483-2d2f-4cfc-919d-ea0c72fab5ff req-67478480-342d-42b4-ab38-b8d89d569554 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Refreshing instance network info cache due to event network-changed-7af832cf-a4a6-4c84-8ca3-0b578347bbc0. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:22:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1e626483-2d2f-4cfc-919d-ea0c72fab5ff req-67478480-342d-42b4-ab38-b8d89d569554 service nova] Acquiring lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:22:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1e626483-2d2f-4cfc-919d-ea0c72fab5ff req-67478480-342d-42b4-ab38-b8d89d569554 service nova] Acquired lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:22:44 user nova-compute[73520]: DEBUG nova.network.neutron [req-1e626483-2d2f-4cfc-919d-ea0c72fab5ff req-67478480-342d-42b4-ab38-b8d89d569554 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Refreshing network info cache for port 7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:22:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "interface-e3236316-dada-4aee-a210-6d9e9950c166-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "interface-e3236316-dada-4aee-a210-6d9e9950c166-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:45 user nova-compute[73520]: DEBUG nova.objects.instance [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lazy-loading 'flavor' on Instance uuid e3236316-dada-4aee-a210-6d9e9950c166 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:45 user nova-compute[73520]: DEBUG nova.network.neutron [req-1e626483-2d2f-4cfc-919d-ea0c72fab5ff req-67478480-342d-42b4-ab38-b8d89d569554 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Updated VIF entry in instance network info cache for port 7af832cf-a4a6-4c84-8ca3-0b578347bbc0. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:22:45 user nova-compute[73520]: DEBUG nova.network.neutron [req-1e626483-2d2f-4cfc-919d-ea0c72fab5ff req-67478480-342d-42b4-ab38-b8d89d569554 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Updating instance_info_cache with network_info: [{"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:22:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1e626483-2d2f-4cfc-919d-ea0c72fab5ff req-67478480-342d-42b4-ab38-b8d89d569554 service nova] Releasing lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:22:45 user nova-compute[73520]: DEBUG nova.objects.instance [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lazy-loading 'pci_requests' on Instance uuid e3236316-dada-4aee-a210-6d9e9950c166 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:45 user nova-compute[73520]: DEBUG nova.network.neutron [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:22:45 user nova-compute[73520]: DEBUG nova.policy [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1830f07ec8441a98454a18fd3a2e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334e1cae88394856b698916811059782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:22:45 user nova-compute[73520]: DEBUG nova.network.neutron [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Successfully created port: da546174-0676-4332-8817-c51ed821f9d3 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:22:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Successfully updated port: da546174-0676-4332-8817-c51ed821f9d3 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:22:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:22:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquired lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:22:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:22:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-53d5d1be-0e94-4d30-954f-b604c73f6533 req-59040437-7b1d-448e-a0ad-8935d1d7f740 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-changed-da546174-0676-4332-8817-c51ed821f9d3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-53d5d1be-0e94-4d30-954f-b604c73f6533 req-59040437-7b1d-448e-a0ad-8935d1d7f740 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Refreshing instance network info cache due to event network-changed-da546174-0676-4332-8817-c51ed821f9d3. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:22:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53d5d1be-0e94-4d30-954f-b604c73f6533 req-59040437-7b1d-448e-a0ad-8935d1d7f740 service nova] Acquiring lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.network.neutron [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Updating instance_info_cache with network_info: [{"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Releasing lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53d5d1be-0e94-4d30-954f-b604c73f6533 req-59040437-7b1d-448e-a0ad-8935d1d7f740 service nova] Acquired lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.network.neutron [req-53d5d1be-0e94-4d30-954f-b604c73f6533 req-59040437-7b1d-448e-a0ad-8935d1d7f740 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Refreshing network info cache for port da546174-0676-4332-8817-c51ed821f9d3 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237150177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237150177',id=23,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLqlkeW8K4/NYjRCJM4DThn3bJr4LmJGxj2R3Ahh8DNjzuZ9KWKu2ENvKunjOIly8U/grW0cxfrq3RvxlK8fCQ+TzP/dQAKgugcoqQDuK4pTxhnxyfh+UcCyNr/VbXPmw==',key_name='tempest-keypair-1386297183',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='334e1cae88394856b698916811059782',ramdisk_id='',reservation_id='r-kqjagab3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1067579941',owner_user_name='tempest-TaggedAttachmentsTest-1067579941-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1830f07ec8441a98454a18fd3a2e5a9',uuid=e3236316-dada-4aee-a210-6d9e9950c166,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converting VIF {"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:68,bridge_name='br-int',has_traffic_filtering=True,id=da546174-0676-4332-8817-c51ed821f9d3,network=Network(7ce71910-8122-4156-9895-ad9f81367011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda546174-06') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG os_vif [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:68,bridge_name='br-int',has_traffic_filtering=True,id=da546174-0676-4332-8817-c51ed821f9d3,network=Network(7ce71910-8122-4156-9895-ad9f81367011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda546174-06') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda546174-06, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda546174-06, col_values=(('external_ids', {'iface-id': 'da546174-0676-4332-8817-c51ed821f9d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:b7:68', 'vm-uuid': 'e3236316-dada-4aee-a210-6d9e9950c166'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:48 user nova-compute[73520]: INFO os_vif [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:68,bridge_name='br-int',has_traffic_filtering=True,id=da546174-0676-4332-8817-c51ed821f9d3,network=Network(7ce71910-8122-4156-9895-ad9f81367011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda546174-06')
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237150177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237150177',id=23,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLqlkeW8K4/NYjRCJM4DThn3bJr4LmJGxj2R3Ahh8DNjzuZ9KWKu2ENvKunjOIly8U/grW0cxfrq3RvxlK8fCQ+TzP/dQAKgugcoqQDuK4pTxhnxyfh+UcCyNr/VbXPmw==',key_name='tempest-keypair-1386297183',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='334e1cae88394856b698916811059782',ramdisk_id='',reservation_id='r-kqjagab3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1067579941',owner_user_name='tempest-TaggedAttachmentsTest-1067579941-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1830f07ec8441a98454a18fd3a2e5a9',uuid=e3236316-dada-4aee-a210-6d9e9950c166,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converting VIF {"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:68,bridge_name='br-int',has_traffic_filtering=True,id=da546174-0676-4332-8817-c51ed821f9d3,network=Network(7ce71910-8122-4156-9895-ad9f81367011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda546174-06') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] attach device xml: <interface type="ethernet">
Aug 16 12:22:48 user nova-compute[73520]:   <mac address="fa:16:3e:bf:b7:68"/>
Aug 16 12:22:48 user nova-compute[73520]:   <model type="virtio"/>
Aug 16 12:22:48 user nova-compute[73520]:   <mtu size="1442"/>
Aug 16 12:22:48 user nova-compute[73520]:   <target dev="tapda546174-06"/>
Aug 16 12:22:48 user nova-compute[73520]: </interface>
Aug 16 12:22:48 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.network.neutron [req-53d5d1be-0e94-4d30-954f-b604c73f6533 req-59040437-7b1d-448e-a0ad-8935d1d7f740 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Updated VIF entry in instance network info cache for port da546174-0676-4332-8817-c51ed821f9d3. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.network.neutron [req-53d5d1be-0e94-4d30-954f-b604c73f6533 req-59040437-7b1d-448e-a0ad-8935d1d7f740 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Updating instance_info_cache with network_info: [{"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-53d5d1be-0e94-4d30-954f-b604c73f6533 req-59040437-7b1d-448e-a0ad-8935d1d7f740 service nova] Releasing lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-ee19c210-de51-429e-8e46-98b33063518c req-c56c2f93-08f8-4ecb-9207-676e1c092aed service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-plugged-da546174-0676-4332-8817-c51ed821f9d3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ee19c210-de51-429e-8e46-98b33063518c req-c56c2f93-08f8-4ecb-9207-676e1c092aed service nova] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ee19c210-de51-429e-8e46-98b33063518c req-c56c2f93-08f8-4ecb-9207-676e1c092aed service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ee19c210-de51-429e-8e46-98b33063518c req-c56c2f93-08f8-4ecb-9207-676e1c092aed service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-ee19c210-de51-429e-8e46-98b33063518c req-c56c2f93-08f8-4ecb-9207-676e1c092aed service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] No waiting events found dispatching network-vif-plugged-da546174-0676-4332-8817-c51ed821f9d3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:48 user nova-compute[73520]: WARNING nova.compute.manager [req-ee19c210-de51-429e-8e46-98b33063518c req-c56c2f93-08f8-4ecb-9207-676e1c092aed service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received unexpected event network-vif-plugged-da546174-0676-4332-8817-c51ed821f9d3 for instance with vm_state active and task_state None.
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] No BDM found with device name hda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] No VIF found with MAC fa:16:3e:a1:f5:32, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:22:49 user nova-compute[73520]:   <nova:package version="0.0.0"/>
Aug 16 12:22:49 user nova-compute[73520]:   <nova:name>tempest-device-tagging-server-1237150177</nova:name>
Aug 16 12:22:49 user nova-compute[73520]:   <nova:creationTime>2023-08-16 12:22:49</nova:creationTime>
Aug 16 12:22:49 user nova-compute[73520]:   <nova:flavor name="m1.tiny">
Aug 16 12:22:49 user nova-compute[73520]:     <nova:memory>512</nova:memory>
Aug 16 12:22:49 user nova-compute[73520]:     <nova:disk>1</nova:disk>
Aug 16 12:22:49 user nova-compute[73520]:     <nova:swap>0</nova:swap>
Aug 16 12:22:49 user nova-compute[73520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:22:49 user nova-compute[73520]:     <nova:vcpus>1</nova:vcpus>
Aug 16 12:22:49 user nova-compute[73520]:   </nova:flavor>
Aug 16 12:22:49 user nova-compute[73520]:   <nova:owner>
Aug 16 12:22:49 user nova-compute[73520]:     <nova:user uuid="d1830f07ec8441a98454a18fd3a2e5a9">tempest-TaggedAttachmentsTest-1067579941-project-member</nova:user>
Aug 16 12:22:49 user nova-compute[73520]:     <nova:project uuid="334e1cae88394856b698916811059782">tempest-TaggedAttachmentsTest-1067579941</nova:project>
Aug 16 12:22:49 user nova-compute[73520]:   </nova:owner>
Aug 16 12:22:49 user nova-compute[73520]:   <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:22:49 user nova-compute[73520]:   <nova:ports>
Aug 16 12:22:49 user nova-compute[73520]:     <nova:port uuid="7af832cf-a4a6-4c84-8ca3-0b578347bbc0">
Aug 16 12:22:49 user nova-compute[73520]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 12:22:49 user nova-compute[73520]:     </nova:port>
Aug 16 12:22:49 user nova-compute[73520]:     <nova:port uuid="da546174-0676-4332-8817-c51ed821f9d3">
Aug 16 12:22:49 user nova-compute[73520]:       <nova:ip type="fixed" address="10.10.10.139" ipVersion="4"/>
Aug 16 12:22:49 user nova-compute[73520]:     </nova:port>
Aug 16 12:22:49 user nova-compute[73520]:   </nova:ports>
Aug 16 12:22:49 user nova-compute[73520]: </nova:instance>
Aug 16 12:22:49 user nova-compute[73520]:  {{(pid=73520) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-78e62825-6efb-4fe9-95e9-290b5010d73b tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "interface-e3236316-dada-4aee-a210-6d9e9950c166-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.966s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "e3236316-dada-4aee-a210-6d9e9950c166" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG nova.objects.instance [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lazy-loading 'flavor' on Instance uuid e3236316-dada-4aee-a210-6d9e9950c166 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "e3236316-dada-4aee-a210-6d9e9950c166" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "e3236316-dada-4aee-a210-6d9e9950c166" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:49 user nova-compute[73520]: INFO nova.compute.manager [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Attaching volume e3990663-517f-43f2-b6be-4c0d26e2d19b to /dev/vdb
Aug 16 12:22:49 user nova-compute[73520]: DEBUG os_brick.utils [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb547601-6a15-44c9-879d-941be12d7c4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c874c8-2a9d-45ec-96dc-253aba543f94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd85fb2-8582-4821-a14a-48883734462b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65b3187-c95a-426c-b08a-439979fcff12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:22:49 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:22:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c09cd4-347b-45ac-8f13-b23f00ed7ede]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG os_brick.utils [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:22:49 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Updating existing volume attachment record: 8e1ece86-3b26-4529-9ac5-0975ac90ca4f {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:22:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-33641e3d-a723-4565-a367-ac8c0ddd7480 req-5537e5b6-bc1e-45d0-8f3e-3daaec6a6f68 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-plugged-da546174-0676-4332-8817-c51ed821f9d3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-33641e3d-a723-4565-a367-ac8c0ddd7480 req-5537e5b6-bc1e-45d0-8f3e-3daaec6a6f68 service nova] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-33641e3d-a723-4565-a367-ac8c0ddd7480 req-5537e5b6-bc1e-45d0-8f3e-3daaec6a6f68 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-33641e3d-a723-4565-a367-ac8c0ddd7480 req-5537e5b6-bc1e-45d0-8f3e-3daaec6a6f68 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-33641e3d-a723-4565-a367-ac8c0ddd7480 req-5537e5b6-bc1e-45d0-8f3e-3daaec6a6f68 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] No waiting events found dispatching network-vif-plugged-da546174-0676-4332-8817-c51ed821f9d3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:50 user nova-compute[73520]: WARNING nova.compute.manager [req-33641e3d-a723-4565-a367-ac8c0ddd7480 req-5537e5b6-bc1e-45d0-8f3e-3daaec6a6f68 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received unexpected event network-vif-plugged-da546174-0676-4332-8817-c51ed821f9d3 for instance with vm_state active and task_state None.
Aug 16 12:22:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:54 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188559.4884129, 70eeda03-767e-4c60-b535-9b250b63513b => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:22:54 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] VM Stopped (Lifecycle Event)
Aug 16 12:22:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-22c516ea-b4e9-47f0-8ba0-a27956cf08b6 None None] [instance: 70eeda03-767e-4c60-b535-9b250b63513b] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:22:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:54 user nova-compute[73520]: INFO nova.compute.manager [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Terminating instance
Aug 16 12:22:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:22:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG nova.compute.manager [req-9067034d-665f-4d89-8c08-8e88e2582c04 req-0eef3a67-5851-4e16-8f5e-ec5c1b7ee42d service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Received event network-vif-unplugged-9477442a-ad39-46dd-8f9d-10063a9c2a10 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9067034d-665f-4d89-8c08-8e88e2582c04 req-0eef3a67-5851-4e16-8f5e-ec5c1b7ee42d service nova] Acquiring lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9067034d-665f-4d89-8c08-8e88e2582c04 req-0eef3a67-5851-4e16-8f5e-ec5c1b7ee42d service nova] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9067034d-665f-4d89-8c08-8e88e2582c04 req-0eef3a67-5851-4e16-8f5e-ec5c1b7ee42d service nova] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG nova.compute.manager [req-9067034d-665f-4d89-8c08-8e88e2582c04 req-0eef3a67-5851-4e16-8f5e-ec5c1b7ee42d service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] No waiting events found dispatching network-vif-unplugged-9477442a-ad39-46dd-8f9d-10063a9c2a10 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG nova.compute.manager [req-9067034d-665f-4d89-8c08-8e88e2582c04 req-0eef3a67-5851-4e16-8f5e-ec5c1b7ee42d service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Received event network-vif-unplugged-9477442a-ad39-46dd-8f9d-10063a9c2a10 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:55 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Instance destroyed successfully.
Aug 16 12:22:55 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lazy-loading 'resources' on Instance uuid 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-346692948',display_name='tempest-ServersNegativeTestJSON-server-346692948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-346692948',id=24,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:21:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95f1f97356574bba85e0596dd1b6ed1f',ramdisk_id='',reservation_id='r-3922ad8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1387585068',owner_user_name='tempest-ServersNegativeTestJSON-1387585068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:21:12Z,user_data=None,user_id='2a3c953350514bab80c857246568c427',uuid=2e0f366b-6e25-44a3-91a8-5bcfa0a701bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "address": "fa:16:3e:84:7f:07", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9477442a-ad", "ovs_interfaceid": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Converting VIF {"id": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "address": "fa:16:3e:84:7f:07", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9477442a-ad", "ovs_interfaceid": "9477442a-ad39-46dd-8f9d-10063a9c2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=9477442a-ad39-46dd-8f9d-10063a9c2a10,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9477442a-ad') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG os_vif [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=9477442a-ad39-46dd-8f9d-10063a9c2a10,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9477442a-ad') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9477442a-ad, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:22:55 user nova-compute[73520]: INFO os_vif [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:7f:07,bridge_name='br-int',has_traffic_filtering=True,id=9477442a-ad39-46dd-8f9d-10063a9c2a10,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9477442a-ad')
Aug 16 12:22:55 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Deleting instance files /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb_del
Aug 16 12:22:55 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Deletion of /opt/stack/data/nova/instances/2e0f366b-6e25-44a3-91a8-5bcfa0a701bb_del complete
Aug 16 12:22:55 user nova-compute[73520]: INFO nova.compute.manager [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 16 12:22:55 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:22:55 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:22:56 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Took 0.62 seconds to deallocate network for instance.
Aug 16 12:22:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:56 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:22:56 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:22:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:56 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Deleted allocations for instance 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb
Aug 16 12:22:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c26f63f5-6969-4b09-a8de-5e37f9b0ed0e tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.959s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-697b8e4b-2c19-497e-a4cc-45c34af99a91 req-79ea051d-48db-4f39-a0ad-7da3c5306336 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Received event network-vif-plugged-9477442a-ad39-46dd-8f9d-10063a9c2a10 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-697b8e4b-2c19-497e-a4cc-45c34af99a91 req-79ea051d-48db-4f39-a0ad-7da3c5306336 service nova] Acquiring lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:22:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-697b8e4b-2c19-497e-a4cc-45c34af99a91 req-79ea051d-48db-4f39-a0ad-7da3c5306336 service nova] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:22:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-697b8e4b-2c19-497e-a4cc-45c34af99a91 req-79ea051d-48db-4f39-a0ad-7da3c5306336 service nova] Lock "2e0f366b-6e25-44a3-91a8-5bcfa0a701bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:22:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-697b8e4b-2c19-497e-a4cc-45c34af99a91 req-79ea051d-48db-4f39-a0ad-7da3c5306336 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] No waiting events found dispatching network-vif-plugged-9477442a-ad39-46dd-8f9d-10063a9c2a10 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:22:57 user nova-compute[73520]: WARNING nova.compute.manager [req-697b8e4b-2c19-497e-a4cc-45c34af99a91 req-79ea051d-48db-4f39-a0ad-7da3c5306336 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Received unexpected event network-vif-plugged-9477442a-ad39-46dd-8f9d-10063a9c2a10 for instance with vm_state deleted and task_state None.
Aug 16 12:22:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-697b8e4b-2c19-497e-a4cc-45c34af99a91 req-79ea051d-48db-4f39-a0ad-7da3c5306336 service nova] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Received event network-vif-deleted-9477442a-ad39-46dd-8f9d-10063a9c2a10 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:22:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPQlFeNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:23:00 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:23:00 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:23:00 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cefdee8-1ade-4c69-a625-0685dc5e8030]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:23:00 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[566bba96-dae5-436d-95f7-d8a7c902dc1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b] added
Aug 16 12:23:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4470ec0-33b5-47cf-a096-e98f75e46e5f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6959e0a-bb23-4f2f-99e7-53ad10b49fbc]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZPQlFeNI {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZPQlFeNI" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d236d2b9-494a-4dba-b930-620d3eeb3ede]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZPQlFeNI'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98a62ae-b95c-4e77-8fd9-d82941f136ff]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6dc38d-f349-49fb-8048-e7e0c7b11436]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:23:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:23:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[484aaed4-ae0e-4126-8d2a-52c7ed64c15e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b, portal: 172.16.0.220,3260]
Aug 16 12:23:00 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b, portal: 172.16.0.220,3260] successful.
Aug 16 12:23:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ecfb89-e07f-4d18-a659-f8285101da0d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea47975-1708-40f2-9f29-69e9a79012b3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b (non-flash)
Aug 16 12:23:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:23:00 user nova-compute[73520]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b (non-flash)
Aug 16 12:23:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d44efd-06db-4a82-973f-7e1ba3c1c692]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:23:01 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:23:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPQlFeNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:23:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:23:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23966346564363862', 'path': '/dev/sde'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:23:01 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966346564363862', 'path': '/dev/sde'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:23:01 user nova-compute[73520]: DEBUG nova.objects.instance [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lazy-loading 'flavor' on Instance uuid e3236316-dada-4aee-a210-6d9e9950c166 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:01 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:23:01 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:23:01 user nova-compute[73520]:   <source dev="/dev/sde"/>
Aug 16 12:23:01 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:23:01 user nova-compute[73520]:   <serial>e3990663-517f-43f2-b6be-4c0d26e2d19b</serial>
Aug 16 12:23:01 user nova-compute[73520]: </disk>
Aug 16 12:23:01 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:23:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:23:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] No BDM found with device name hda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:23:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] No VIF found with MAC fa:16:3e:a1:f5:32, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:23:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-deffd669-5537-4a7b-9e64-20d120d4def7 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "e3236316-dada-4aee-a210-6d9e9950c166" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.761s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:03 user nova-compute[73520]: INFO nova.compute.manager [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Detaching volume 6f93eb09-4320-4998-b6b3-2e0568019c81
Aug 16 12:23:03 user nova-compute[73520]: INFO nova.virt.block_device [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Attempting to driver detach volume 6f93eb09-4320-4998-b6b3-2e0568019c81 from mountpoint /dev/vdc
Aug 16 12:23:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Attempting to detach device vdc from instance b58731e0-399d-4f8d-84b8-af12a46cf87f from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:23:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:23:03 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:23:03 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:23:03 user nova-compute[73520]:   <target dev="vdc" bus="virtio"/>
Aug 16 12:23:03 user nova-compute[73520]:   <serial>6f93eb09-4320-4998-b6b3-2e0568019c81</serial>
Aug 16 12:23:03 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 12:23:03 user nova-compute[73520]: </disk>
Aug 16 12:23:03 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:23:03 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Successfully detached device vdc from instance b58731e0-399d-4f8d-84b8-af12a46cf87f from the persistent domain config.
Aug 16 12:23:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b58731e0-399d-4f8d-84b8-af12a46cf87f from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:23:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:23:03 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:23:03 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:23:03 user nova-compute[73520]:   <target dev="vdc" bus="virtio"/>
Aug 16 12:23:03 user nova-compute[73520]:   <serial>6f93eb09-4320-4998-b6b3-2e0568019c81</serial>
Aug 16 12:23:03 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 12:23:03 user nova-compute[73520]: </disk>
Aug 16 12:23:03 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "e3236316-dada-4aee-a210-6d9e9950c166" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:04 user nova-compute[73520]: INFO nova.compute.manager [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Detaching volume e3990663-517f-43f2-b6be-4c0d26e2d19b
Aug 16 12:23:04 user nova-compute[73520]: INFO nova.virt.block_device [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Attempting to driver detach volume e3990663-517f-43f2-b6be-4c0d26e2d19b from mountpoint /dev/vdb
Aug 16 12:23:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Attempting to detach device vdb from instance e3236316-dada-4aee-a210-6d9e9950c166 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:23:04 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:23:04 user nova-compute[73520]:   <source dev="/dev/sde"/>
Aug 16 12:23:04 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:23:04 user nova-compute[73520]:   <serial>e3990663-517f-43f2-b6be-4c0d26e2d19b</serial>
Aug 16 12:23:04 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 12:23:04 user nova-compute[73520]: </disk>
Aug 16 12:23:04 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:23:04 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Successfully detached device vdb from instance e3236316-dada-4aee-a210-6d9e9950c166 from the persistent domain config.
Aug 16 12:23:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3236316-dada-4aee-a210-6d9e9950c166 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:23:04 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:23:04 user nova-compute[73520]:   <source dev="/dev/sde"/>
Aug 16 12:23:04 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:23:04 user nova-compute[73520]:   <serial>e3990663-517f-43f2-b6be-4c0d26e2d19b</serial>
Aug 16 12:23:04 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 12:23:04 user nova-compute[73520]: </disk>
Aug 16 12:23:04 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188584.251486, b58731e0-399d-4f8d-84b8-af12a46cf87f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:23:04 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Successfully detached device vdc from instance b58731e0-399d-4f8d-84b8-af12a46cf87f from the live domain config.
Aug 16 12:23:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MSJNDkyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:23:04 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef15ce0e-d64a-4933-8110-3a04974c4f94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea67aba-1163-490a-ab3c-e0e71b8b44b6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b (non-flash)
Aug 16 12:23:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b (non-flash)
Aug 16 12:23:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c67a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4303bbf9-d027-45f1-81a0-26c2501e45c3]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[68576090-0c5c-4945-93ba-989036dfd8c5]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6d7e6d-0aa4-4a85-b606-63396609046e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfce8878-7f50-49ed-b38b-5bffa7a8f1e5]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0590aa73-71e8-4fa2-afd8-8444e31d89cc]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb5876a-2e31-4015-992e-d681a6d21473]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81, portal: 172.16.0.220,3260]
Aug 16 12:23:04 user nova-compute[73520]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81, portal: 172.16.0.220,3260] successful.
Aug 16 12:23:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f93eb09-4320-4998-b6b3-2e0568019c81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[115f3bf1-485b-4af5-b162-db06bf007c04]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] <== disconnect_volume: return (313ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188584.6659772, e3236316-dada-4aee-a210-6d9e9950c166 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3236316-dada-4aee-a210-6d9e9950c166 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:23:04 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Successfully detached device vdb from instance e3236316-dada-4aee-a210-6d9e9950c166 from the live domain config.
Aug 16 12:23:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPQlFeNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:23:04 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[467c508f-42b6-43ef-b53d-535f05930875]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[82219b07-bfd5-41f9-9a56-0d54c4508449]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b (non-flash)
Aug 16 12:23:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:23:04 user nova-compute[73520]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b (non-flash)
Aug 16 12:23:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c692710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b'): ({'sde'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Removing single pathed devices sde {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc14412b-8ead-4cda-8a34-ea5e85191e95]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[16693bf2-22d3-4aa7-a4d6-92d934a5ce36]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Flushing IO for device /dev/sde {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcf1f67-a4f0-4d16-9cfa-9e176749d24e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2e8112-5375-4e5d-ad9b-f0f74153c00a]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39b793b-6bfe-4df0-b98e-c2bb7fe910b2]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bf3998-074c-4d9e-8805-d7a2a2eda895]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b, portal: 172.16.0.220,3260]
Aug 16 12:23:04 user nova-compute[73520]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b, portal: 172.16.0.220,3260] successful.
Aug 16 12:23:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3990663-517f-43f2-b6be-4c0d26e2d19b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef6519e-9a54-4eb6-8e7c-12ef258040f5]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] <== disconnect_volume: return (302ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:23:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:23:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:05 user nova-compute[73520]: DEBUG nova.objects.instance [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'flavor' on Instance uuid b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cf027151-4d66-4d0a-961d-05ec50a196bb tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.752s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:05 user nova-compute[73520]: DEBUG nova.objects.instance [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lazy-loading 'flavor' on Instance uuid e3236316-dada-4aee-a210-6d9e9950c166 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-646a0066-11b5-4bef-bd33-7369f9698f92 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "e3236316-dada-4aee-a210-6d9e9950c166" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.731s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "interface-e3236316-dada-4aee-a210-6d9e9950c166-da546174-0676-4332-8817-c51ed821f9d3" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "interface-e3236316-dada-4aee-a210-6d9e9950c166-da546174-0676-4332-8817-c51ed821f9d3" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.objects.instance [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lazy-loading 'flavor' on Instance uuid e3236316-dada-4aee-a210-6d9e9950c166 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237150177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237150177',id=23,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLqlkeW8K4/NYjRCJM4DThn3bJr4LmJGxj2R3Ahh8DNjzuZ9KWKu2ENvKunjOIly8U/grW0cxfrq3RvxlK8fCQ+TzP/dQAKgugcoqQDuK4pTxhnxyfh+UcCyNr/VbXPmw==',key_name='tempest-keypair-1386297183',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='334e1cae88394856b698916811059782',ramdisk_id='',reservation_id='r-kqjagab3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1067579941',owner_user_name='tempest-TaggedAttachmentsTest-1067579941-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1830f07ec8441a98454a18fd3a2e5a9',uuid=e3236316-dada-4aee-a210-6d9e9950c166,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converting VIF {"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:68,bridge_name='br-int',has_traffic_filtering=True,id=da546174-0676-4332-8817-c51ed821f9d3,network=Network(7ce71910-8122-4156-9895-ad9f81367011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda546174-06') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bf:b7:68"/><model type="virtio"/><mtu size="1442"/><target dev="tapda546174-06"/></interface> {{(pid=73520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bf:b7:68"/><model type="virtio"/><mtu size="1442"/><target dev="tapda546174-06"/></interface> {{(pid=73520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Attempting to detach device tapda546174-06 from instance e3236316-dada-4aee-a210-6d9e9950c166 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] detach device xml: <interface type="ethernet">
Aug 16 12:23:06 user nova-compute[73520]:   <mac address="fa:16:3e:bf:b7:68"/>
Aug 16 12:23:06 user nova-compute[73520]:   <model type="virtio"/>
Aug 16 12:23:06 user nova-compute[73520]:   <mtu size="1442"/>
Aug 16 12:23:06 user nova-compute[73520]:   <target dev="tapda546174-06"/>
Aug 16 12:23:06 user nova-compute[73520]: </interface>
Aug 16 12:23:06 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bf:b7:68"/><model type="virtio"/><mtu size="1442"/><target dev="tapda546174-06"/></interface> {{(pid=73520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bf:b7:68"/><model type="virtio"/><mtu size="1442"/><target dev="tapda546174-06"/></interface>not found in domain: <domain type='kvm' id='27'>
Aug 16 12:23:06 user nova-compute[73520]:   <name>instance-00000017</name>
Aug 16 12:23:06 user nova-compute[73520]:   <uuid>e3236316-dada-4aee-a210-6d9e9950c166</uuid>
Aug 16 12:23:06 user nova-compute[73520]:   <metadata>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:23:06 user nova-compute[73520]:   <nova:package version="0.0.0"/>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:name>tempest-device-tagging-server-1237150177</nova:name>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:creationTime>2023-08-16 12:22:49</nova:creationTime>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:flavor name="m1.tiny">
Aug 16 12:23:06 user nova-compute[73520]:     <nova:memory>512</nova:memory>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:disk>1</nova:disk>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:swap>0</nova:swap>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:vcpus>1</nova:vcpus>
Aug 16 12:23:06 user nova-compute[73520]:   </nova:flavor>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:owner>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:user uuid="d1830f07ec8441a98454a18fd3a2e5a9">tempest-TaggedAttachmentsTest-1067579941-project-member</nova:user>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:project uuid="334e1cae88394856b698916811059782">tempest-TaggedAttachmentsTest-1067579941</nova:project>
Aug 16 12:23:06 user nova-compute[73520]:   </nova:owner>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:ports>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:port uuid="7af832cf-a4a6-4c84-8ca3-0b578347bbc0">
Aug 16 12:23:06 user nova-compute[73520]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 12:23:06 user nova-compute[73520]:     </nova:port>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:port uuid="da546174-0676-4332-8817-c51ed821f9d3">
Aug 16 12:23:06 user nova-compute[73520]:       <nova:ip type="fixed" address="10.10.10.139" ipVersion="4"/>
Aug 16 12:23:06 user nova-compute[73520]:     </nova:port>
Aug 16 12:23:06 user nova-compute[73520]:   </nova:ports>
Aug 16 12:23:06 user nova-compute[73520]: </nova:instance>
Aug 16 12:23:06 user nova-compute[73520]:   </metadata>
Aug 16 12:23:06 user nova-compute[73520]:   <memory unit='KiB'>524288</memory>
Aug 16 12:23:06 user nova-compute[73520]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 12:23:06 user nova-compute[73520]:   <vcpu placement='static'>1</vcpu>
Aug 16 12:23:06 user nova-compute[73520]:   <resource>
Aug 16 12:23:06 user nova-compute[73520]:     <partition>/machine</partition>
Aug 16 12:23:06 user nova-compute[73520]:   </resource>
Aug 16 12:23:06 user nova-compute[73520]:   <sysinfo type='smbios'>
Aug 16 12:23:06 user nova-compute[73520]:     <system>
Aug 16 12:23:06 user nova-compute[73520]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 12:23:06 user nova-compute[73520]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 12:23:06 user nova-compute[73520]:       <entry name='version'>0.0.0</entry>
Aug 16 12:23:06 user nova-compute[73520]:       <entry name='serial'>e3236316-dada-4aee-a210-6d9e9950c166</entry>
Aug 16 12:23:06 user nova-compute[73520]:       <entry name='uuid'>e3236316-dada-4aee-a210-6d9e9950c166</entry>
Aug 16 12:23:06 user nova-compute[73520]:       <entry name='family'>Virtual Machine</entry>
Aug 16 12:23:06 user nova-compute[73520]:     </system>
Aug 16 12:23:06 user nova-compute[73520]:   </sysinfo>
Aug 16 12:23:06 user nova-compute[73520]:   <os>
Aug 16 12:23:06 user nova-compute[73520]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 12:23:06 user nova-compute[73520]:     <boot dev='hd'/>
Aug 16 12:23:06 user nova-compute[73520]:     <smbios mode='sysinfo'/>
Aug 16 12:23:06 user nova-compute[73520]:   </os>
Aug 16 12:23:06 user nova-compute[73520]:   <features>
Aug 16 12:23:06 user nova-compute[73520]:     <acpi/>
Aug 16 12:23:06 user nova-compute[73520]:     <apic/>
Aug 16 12:23:06 user nova-compute[73520]:     <vmcoreinfo state='on'/>
Aug 16 12:23:06 user nova-compute[73520]:   </features>
Aug 16 12:23:06 user nova-compute[73520]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 12:23:06 user nova-compute[73520]:     <model fallback='forbid'>Nehalem</model>
Aug 16 12:23:06 user nova-compute[73520]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 12:23:06 user nova-compute[73520]:     <feature policy='require' name='vme'/>
Aug 16 12:23:06 user nova-compute[73520]:     <feature policy='require' name='x2apic'/>
Aug 16 12:23:06 user nova-compute[73520]:     <feature policy='require' name='hypervisor'/>
Aug 16 12:23:06 user nova-compute[73520]:   </cpu>
Aug 16 12:23:06 user nova-compute[73520]:   <clock offset='utc'>
Aug 16 12:23:06 user nova-compute[73520]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 12:23:06 user nova-compute[73520]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 12:23:06 user nova-compute[73520]:     <timer name='hpet' present='no'/>
Aug 16 12:23:06 user nova-compute[73520]:   </clock>
Aug 16 12:23:06 user nova-compute[73520]:   <on_poweroff>destroy</on_poweroff>
Aug 16 12:23:06 user nova-compute[73520]:   <on_reboot>restart</on_reboot>
Aug 16 12:23:06 user nova-compute[73520]:   <on_crash>destroy</on_crash>
Aug 16 12:23:06 user nova-compute[73520]:   <devices>
Aug 16 12:23:06 user nova-compute[73520]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 12:23:06 user nova-compute[73520]:     <disk type='file' device='disk'>
Aug 16 12:23:06 user nova-compute[73520]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 12:23:06 user nova-compute[73520]:       <source file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk' index='2'/>
Aug 16 12:23:06 user nova-compute[73520]:       <backingStore type='file' index='3'>
Aug 16 12:23:06 user nova-compute[73520]:         <format type='raw'/>
Aug 16 12:23:06 user nova-compute[73520]:         <source file='/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61'/>
Aug 16 12:23:06 user nova-compute[73520]:         <backingStore/>
Aug 16 12:23:06 user nova-compute[73520]:       </backingStore>
Aug 16 12:23:06 user nova-compute[73520]:       <target dev='vda' bus='virtio'/>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='virtio-disk0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </disk>
Aug 16 12:23:06 user nova-compute[73520]:     <disk type='file' device='cdrom'>
Aug 16 12:23:06 user nova-compute[73520]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 12:23:06 user nova-compute[73520]:       <source file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk.config' index='1'/>
Aug 16 12:23:06 user nova-compute[73520]:       <backingStore/>
Aug 16 12:23:06 user nova-compute[73520]:       <target dev='hda' bus='ide'/>
Aug 16 12:23:06 user nova-compute[73520]:       <readonly/>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='ide0-0-0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </disk>
Aug 16 12:23:06 user nova-compute[73520]:     <controller type='usb' index='0' model='none'>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='usb'/>
Aug 16 12:23:06 user nova-compute[73520]:     </controller>
Aug 16 12:23:06 user nova-compute[73520]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='pci.0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </controller>
Aug 16 12:23:06 user nova-compute[73520]:     <controller type='ide' index='0'>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='ide'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 12:23:06 user nova-compute[73520]:     </controller>
Aug 16 12:23:06 user nova-compute[73520]:     <interface type='ethernet'>
Aug 16 12:23:06 user nova-compute[73520]:       <mac address='fa:16:3e:a1:f5:32'/>
Aug 16 12:23:06 user nova-compute[73520]:       <target dev='tap7af832cf-a4'/>
Aug 16 12:23:06 user nova-compute[73520]:       <model type='virtio'/>
Aug 16 12:23:06 user nova-compute[73520]:       <mtu size='1442'/>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='net0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </interface>
Aug 16 12:23:06 user nova-compute[73520]:     <interface type='ethernet'>
Aug 16 12:23:06 user nova-compute[73520]:       <mac address='fa:16:3e:bf:b7:68'/>
Aug 16 12:23:06 user nova-compute[73520]:       <target dev='tapda546174-06'/>
Aug 16 12:23:06 user nova-compute[73520]:       <model type='virtio'/>
Aug 16 12:23:06 user nova-compute[73520]:       <mtu size='1442'/>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='net1'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </interface>
Aug 16 12:23:06 user nova-compute[73520]:     <serial type='pty'>
Aug 16 12:23:06 user nova-compute[73520]:       <source path='/dev/pts/0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <log file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/console.log' append='off'/>
Aug 16 12:23:06 user nova-compute[73520]:       <target type='isa-serial' port='0'>
Aug 16 12:23:06 user nova-compute[73520]:         <model name='isa-serial'/>
Aug 16 12:23:06 user nova-compute[73520]:       </target>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='serial0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </serial>
Aug 16 12:23:06 user nova-compute[73520]:     <console type='pty' tty='/dev/pts/0'>
Aug 16 12:23:06 user nova-compute[73520]:       <source path='/dev/pts/0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <log file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/console.log' append='off'/>
Aug 16 12:23:06 user nova-compute[73520]:       <target type='serial' port='0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='serial0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </console>
Aug 16 12:23:06 user nova-compute[73520]:     <input type='mouse' bus='ps2'>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='input0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </input>
Aug 16 12:23:06 user nova-compute[73520]:     <input type='keyboard' bus='ps2'>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='input1'/>
Aug 16 12:23:06 user nova-compute[73520]:     </input>
Aug 16 12:23:06 user nova-compute[73520]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Aug 16 12:23:06 user nova-compute[73520]:       <listen type='address' address='0.0.0.0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </graphics>
Aug 16 12:23:06 user nova-compute[73520]:     <audio id='1' type='none'/>
Aug 16 12:23:06 user nova-compute[73520]:     <video>
Aug 16 12:23:06 user nova-compute[73520]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='video0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </video>
Aug 16 12:23:06 user nova-compute[73520]:     <memballoon model='virtio'>
Aug 16 12:23:06 user nova-compute[73520]:       <stats period='10'/>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='balloon0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </memballoon>
Aug 16 12:23:06 user nova-compute[73520]:     <rng model='virtio'>
Aug 16 12:23:06 user nova-compute[73520]:       <backend model='random'>/dev/urandom</backend>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='rng0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </rng>
Aug 16 12:23:06 user nova-compute[73520]:   </devices>
Aug 16 12:23:06 user nova-compute[73520]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 12:23:06 user nova-compute[73520]:     <label>libvirt-e3236316-dada-4aee-a210-6d9e9950c166</label>
Aug 16 12:23:06 user nova-compute[73520]:     <imagelabel>libvirt-e3236316-dada-4aee-a210-6d9e9950c166</imagelabel>
Aug 16 12:23:06 user nova-compute[73520]:   </seclabel>
Aug 16 12:23:06 user nova-compute[73520]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 12:23:06 user nova-compute[73520]:     <label>+64055:+108</label>
Aug 16 12:23:06 user nova-compute[73520]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 12:23:06 user nova-compute[73520]:   </seclabel>
Aug 16 12:23:06 user nova-compute[73520]: </domain>
Aug 16 12:23:06 user nova-compute[73520]:  {{(pid=73520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 12:23:06 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Successfully detached device tapda546174-06 from instance e3236316-dada-4aee-a210-6d9e9950c166 from the persistent domain config.
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] (1/8): Attempting to detach device tapda546174-06 with device alias net1 from instance e3236316-dada-4aee-a210-6d9e9950c166 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] detach device xml: <interface type="ethernet">
Aug 16 12:23:06 user nova-compute[73520]:   <mac address="fa:16:3e:bf:b7:68"/>
Aug 16 12:23:06 user nova-compute[73520]:   <model type="virtio"/>
Aug 16 12:23:06 user nova-compute[73520]:   <mtu size="1442"/>
Aug 16 12:23:06 user nova-compute[73520]:   <target dev="tapda546174-06"/>
Aug 16 12:23:06 user nova-compute[73520]: </interface>
Aug 16 12:23:06 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188586.8306556, e3236316-dada-4aee-a210-6d9e9950c166 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Start waiting for the detach event from libvirt for device tapda546174-06 with device alias net1 for instance e3236316-dada-4aee-a210-6d9e9950c166 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bf:b7:68"/><model type="virtio"/><mtu size="1442"/><target dev="tapda546174-06"/></interface> {{(pid=73520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bf:b7:68"/><model type="virtio"/><mtu size="1442"/><target dev="tapda546174-06"/></interface>not found in domain: <domain type='kvm' id='27'>
Aug 16 12:23:06 user nova-compute[73520]:   <name>instance-00000017</name>
Aug 16 12:23:06 user nova-compute[73520]:   <uuid>e3236316-dada-4aee-a210-6d9e9950c166</uuid>
Aug 16 12:23:06 user nova-compute[73520]:   <metadata>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:23:06 user nova-compute[73520]:   <nova:package version="0.0.0"/>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:name>tempest-device-tagging-server-1237150177</nova:name>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:creationTime>2023-08-16 12:22:49</nova:creationTime>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:flavor name="m1.tiny">
Aug 16 12:23:06 user nova-compute[73520]:     <nova:memory>512</nova:memory>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:disk>1</nova:disk>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:swap>0</nova:swap>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:vcpus>1</nova:vcpus>
Aug 16 12:23:06 user nova-compute[73520]:   </nova:flavor>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:owner>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:user uuid="d1830f07ec8441a98454a18fd3a2e5a9">tempest-TaggedAttachmentsTest-1067579941-project-member</nova:user>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:project uuid="334e1cae88394856b698916811059782">tempest-TaggedAttachmentsTest-1067579941</nova:project>
Aug 16 12:23:06 user nova-compute[73520]:   </nova:owner>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:ports>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:port uuid="7af832cf-a4a6-4c84-8ca3-0b578347bbc0">
Aug 16 12:23:06 user nova-compute[73520]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 12:23:06 user nova-compute[73520]:     </nova:port>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:port uuid="da546174-0676-4332-8817-c51ed821f9d3">
Aug 16 12:23:06 user nova-compute[73520]:       <nova:ip type="fixed" address="10.10.10.139" ipVersion="4"/>
Aug 16 12:23:06 user nova-compute[73520]:     </nova:port>
Aug 16 12:23:06 user nova-compute[73520]:   </nova:ports>
Aug 16 12:23:06 user nova-compute[73520]: </nova:instance>
Aug 16 12:23:06 user nova-compute[73520]:   </metadata>
Aug 16 12:23:06 user nova-compute[73520]:   <memory unit='KiB'>524288</memory>
Aug 16 12:23:06 user nova-compute[73520]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 12:23:06 user nova-compute[73520]:   <vcpu placement='static'>1</vcpu>
Aug 16 12:23:06 user nova-compute[73520]:   <resource>
Aug 16 12:23:06 user nova-compute[73520]:     <partition>/machine</partition>
Aug 16 12:23:06 user nova-compute[73520]:   </resource>
Aug 16 12:23:06 user nova-compute[73520]:   <sysinfo type='smbios'>
Aug 16 12:23:06 user nova-compute[73520]:     <system>
Aug 16 12:23:06 user nova-compute[73520]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 12:23:06 user nova-compute[73520]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 12:23:06 user nova-compute[73520]:       <entry name='version'>0.0.0</entry>
Aug 16 12:23:06 user nova-compute[73520]:       <entry name='serial'>e3236316-dada-4aee-a210-6d9e9950c166</entry>
Aug 16 12:23:06 user nova-compute[73520]:       <entry name='uuid'>e3236316-dada-4aee-a210-6d9e9950c166</entry>
Aug 16 12:23:06 user nova-compute[73520]:       <entry name='family'>Virtual Machine</entry>
Aug 16 12:23:06 user nova-compute[73520]:     </system>
Aug 16 12:23:06 user nova-compute[73520]:   </sysinfo>
Aug 16 12:23:06 user nova-compute[73520]:   <os>
Aug 16 12:23:06 user nova-compute[73520]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 12:23:06 user nova-compute[73520]:     <boot dev='hd'/>
Aug 16 12:23:06 user nova-compute[73520]:     <smbios mode='sysinfo'/>
Aug 16 12:23:06 user nova-compute[73520]:   </os>
Aug 16 12:23:06 user nova-compute[73520]:   <features>
Aug 16 12:23:06 user nova-compute[73520]:     <acpi/>
Aug 16 12:23:06 user nova-compute[73520]:     <apic/>
Aug 16 12:23:06 user nova-compute[73520]:     <vmcoreinfo state='on'/>
Aug 16 12:23:06 user nova-compute[73520]:   </features>
Aug 16 12:23:06 user nova-compute[73520]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 12:23:06 user nova-compute[73520]:     <model fallback='forbid'>Nehalem</model>
Aug 16 12:23:06 user nova-compute[73520]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 12:23:06 user nova-compute[73520]:     <feature policy='require' name='vme'/>
Aug 16 12:23:06 user nova-compute[73520]:     <feature policy='require' name='x2apic'/>
Aug 16 12:23:06 user nova-compute[73520]:     <feature policy='require' name='hypervisor'/>
Aug 16 12:23:06 user nova-compute[73520]:   </cpu>
Aug 16 12:23:06 user nova-compute[73520]:   <clock offset='utc'>
Aug 16 12:23:06 user nova-compute[73520]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 12:23:06 user nova-compute[73520]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 12:23:06 user nova-compute[73520]:     <timer name='hpet' present='no'/>
Aug 16 12:23:06 user nova-compute[73520]:   </clock>
Aug 16 12:23:06 user nova-compute[73520]:   <on_poweroff>destroy</on_poweroff>
Aug 16 12:23:06 user nova-compute[73520]:   <on_reboot>restart</on_reboot>
Aug 16 12:23:06 user nova-compute[73520]:   <on_crash>destroy</on_crash>
Aug 16 12:23:06 user nova-compute[73520]:   <devices>
Aug 16 12:23:06 user nova-compute[73520]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 12:23:06 user nova-compute[73520]:     <disk type='file' device='disk'>
Aug 16 12:23:06 user nova-compute[73520]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 12:23:06 user nova-compute[73520]:       <source file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk' index='2'/>
Aug 16 12:23:06 user nova-compute[73520]:       <backingStore type='file' index='3'>
Aug 16 12:23:06 user nova-compute[73520]:         <format type='raw'/>
Aug 16 12:23:06 user nova-compute[73520]:         <source file='/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61'/>
Aug 16 12:23:06 user nova-compute[73520]:         <backingStore/>
Aug 16 12:23:06 user nova-compute[73520]:       </backingStore>
Aug 16 12:23:06 user nova-compute[73520]:       <target dev='vda' bus='virtio'/>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='virtio-disk0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </disk>
Aug 16 12:23:06 user nova-compute[73520]:     <disk type='file' device='cdrom'>
Aug 16 12:23:06 user nova-compute[73520]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 12:23:06 user nova-compute[73520]:       <source file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk.config' index='1'/>
Aug 16 12:23:06 user nova-compute[73520]:       <backingStore/>
Aug 16 12:23:06 user nova-compute[73520]:       <target dev='hda' bus='ide'/>
Aug 16 12:23:06 user nova-compute[73520]:       <readonly/>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='ide0-0-0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </disk>
Aug 16 12:23:06 user nova-compute[73520]:     <controller type='usb' index='0' model='none'>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='usb'/>
Aug 16 12:23:06 user nova-compute[73520]:     </controller>
Aug 16 12:23:06 user nova-compute[73520]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='pci.0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </controller>
Aug 16 12:23:06 user nova-compute[73520]:     <controller type='ide' index='0'>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='ide'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 12:23:06 user nova-compute[73520]:     </controller>
Aug 16 12:23:06 user nova-compute[73520]:     <interface type='ethernet'>
Aug 16 12:23:06 user nova-compute[73520]:       <mac address='fa:16:3e:a1:f5:32'/>
Aug 16 12:23:06 user nova-compute[73520]:       <target dev='tap7af832cf-a4'/>
Aug 16 12:23:06 user nova-compute[73520]:       <model type='virtio'/>
Aug 16 12:23:06 user nova-compute[73520]:       <mtu size='1442'/>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='net0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </interface>
Aug 16 12:23:06 user nova-compute[73520]:     <serial type='pty'>
Aug 16 12:23:06 user nova-compute[73520]:       <source path='/dev/pts/0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <log file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/console.log' append='off'/>
Aug 16 12:23:06 user nova-compute[73520]:       <target type='isa-serial' port='0'>
Aug 16 12:23:06 user nova-compute[73520]:         <model name='isa-serial'/>
Aug 16 12:23:06 user nova-compute[73520]:       </target>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='serial0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </serial>
Aug 16 12:23:06 user nova-compute[73520]:     <console type='pty' tty='/dev/pts/0'>
Aug 16 12:23:06 user nova-compute[73520]:       <source path='/dev/pts/0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <log file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/console.log' append='off'/>
Aug 16 12:23:06 user nova-compute[73520]:       <target type='serial' port='0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='serial0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </console>
Aug 16 12:23:06 user nova-compute[73520]:     <input type='mouse' bus='ps2'>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='input0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </input>
Aug 16 12:23:06 user nova-compute[73520]:     <input type='keyboard' bus='ps2'>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='input1'/>
Aug 16 12:23:06 user nova-compute[73520]:     </input>
Aug 16 12:23:06 user nova-compute[73520]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Aug 16 12:23:06 user nova-compute[73520]:       <listen type='address' address='0.0.0.0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </graphics>
Aug 16 12:23:06 user nova-compute[73520]:     <audio id='1' type='none'/>
Aug 16 12:23:06 user nova-compute[73520]:     <video>
Aug 16 12:23:06 user nova-compute[73520]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='video0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </video>
Aug 16 12:23:06 user nova-compute[73520]:     <memballoon model='virtio'>
Aug 16 12:23:06 user nova-compute[73520]:       <stats period='10'/>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='balloon0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </memballoon>
Aug 16 12:23:06 user nova-compute[73520]:     <rng model='virtio'>
Aug 16 12:23:06 user nova-compute[73520]:       <backend model='random'>/dev/urandom</backend>
Aug 16 12:23:06 user nova-compute[73520]:       <alias name='rng0'/>
Aug 16 12:23:06 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 12:23:06 user nova-compute[73520]:     </rng>
Aug 16 12:23:06 user nova-compute[73520]:   </devices>
Aug 16 12:23:06 user nova-compute[73520]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 12:23:06 user nova-compute[73520]:     <label>libvirt-e3236316-dada-4aee-a210-6d9e9950c166</label>
Aug 16 12:23:06 user nova-compute[73520]:     <imagelabel>libvirt-e3236316-dada-4aee-a210-6d9e9950c166</imagelabel>
Aug 16 12:23:06 user nova-compute[73520]:   </seclabel>
Aug 16 12:23:06 user nova-compute[73520]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 12:23:06 user nova-compute[73520]:     <label>+64055:+108</label>
Aug 16 12:23:06 user nova-compute[73520]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 12:23:06 user nova-compute[73520]:   </seclabel>
Aug 16 12:23:06 user nova-compute[73520]: </domain>
Aug 16 12:23:06 user nova-compute[73520]:  {{(pid=73520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 12:23:06 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Successfully detached device tapda546174-06 from instance e3236316-dada-4aee-a210-6d9e9950c166 from the live domain config.
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237150177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237150177',id=23,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLqlkeW8K4/NYjRCJM4DThn3bJr4LmJGxj2R3Ahh8DNjzuZ9KWKu2ENvKunjOIly8U/grW0cxfrq3RvxlK8fCQ+TzP/dQAKgugcoqQDuK4pTxhnxyfh+UcCyNr/VbXPmw==',key_name='tempest-keypair-1386297183',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='334e1cae88394856b698916811059782',ramdisk_id='',reservation_id='r-kqjagab3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1067579941',owner_user_name='tempest-TaggedAttachmentsTest-1067579941-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1830f07ec8441a98454a18fd3a2e5a9',uuid=e3236316-dada-4aee-a210-6d9e9950c166,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converting VIF {"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:68,bridge_name='br-int',has_traffic_filtering=True,id=da546174-0676-4332-8817-c51ed821f9d3,network=Network(7ce71910-8122-4156-9895-ad9f81367011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda546174-06') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG os_vif [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:68,bridge_name='br-int',has_traffic_filtering=True,id=da546174-0676-4332-8817-c51ed821f9d3,network=Network(7ce71910-8122-4156-9895-ad9f81367011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda546174-06') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda546174-06, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:06 user nova-compute[73520]: INFO os_vif [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:68,bridge_name='br-int',has_traffic_filtering=True,id=da546174-0676-4332-8817-c51ed821f9d3,network=Network(7ce71910-8122-4156-9895-ad9f81367011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda546174-06')
Aug 16 12:23:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:23:06 user nova-compute[73520]:   <nova:package version="0.0.0"/>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:name>tempest-device-tagging-server-1237150177</nova:name>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:creationTime>2023-08-16 12:23:06</nova:creationTime>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:flavor name="m1.tiny">
Aug 16 12:23:06 user nova-compute[73520]:     <nova:memory>512</nova:memory>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:disk>1</nova:disk>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:swap>0</nova:swap>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:vcpus>1</nova:vcpus>
Aug 16 12:23:06 user nova-compute[73520]:   </nova:flavor>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:owner>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:user uuid="d1830f07ec8441a98454a18fd3a2e5a9">tempest-TaggedAttachmentsTest-1067579941-project-member</nova:user>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:project uuid="334e1cae88394856b698916811059782">tempest-TaggedAttachmentsTest-1067579941</nova:project>
Aug 16 12:23:06 user nova-compute[73520]:   </nova:owner>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:23:06 user nova-compute[73520]:   <nova:ports>
Aug 16 12:23:06 user nova-compute[73520]:     <nova:port uuid="7af832cf-a4a6-4c84-8ca3-0b578347bbc0">
Aug 16 12:23:06 user nova-compute[73520]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 12:23:06 user nova-compute[73520]:     </nova:port>
Aug 16 12:23:06 user nova-compute[73520]:   </nova:ports>
Aug 16 12:23:06 user nova-compute[73520]: </nova:instance>
Aug 16 12:23:06 user nova-compute[73520]:  {{(pid=73520) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-131881aa-2bef-41a4-8643-ecd8bcfbd9da req-ed9484d2-7381-4839-aca1-2d26fe1de811 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-unplugged-da546174-0676-4332-8817-c51ed821f9d3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-131881aa-2bef-41a4-8643-ecd8bcfbd9da req-ed9484d2-7381-4839-aca1-2d26fe1de811 service nova] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-131881aa-2bef-41a4-8643-ecd8bcfbd9da req-ed9484d2-7381-4839-aca1-2d26fe1de811 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-131881aa-2bef-41a4-8643-ecd8bcfbd9da req-ed9484d2-7381-4839-aca1-2d26fe1de811 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-131881aa-2bef-41a4-8643-ecd8bcfbd9da req-ed9484d2-7381-4839-aca1-2d26fe1de811 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] No waiting events found dispatching network-vif-unplugged-da546174-0676-4332-8817-c51ed821f9d3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:07 user nova-compute[73520]: WARNING nova.compute.manager [req-131881aa-2bef-41a4-8643-ecd8bcfbd9da req-ed9484d2-7381-4839-aca1-2d26fe1de811 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received unexpected event network-vif-unplugged-da546174-0676-4332-8817-c51ed821f9d3 for instance with vm_state active and task_state None.
Aug 16 12:23:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-deleted-da546174-0676-4332-8817-c51ed821f9d3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:07 user nova-compute[73520]: INFO nova.compute.manager [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Neutron deleted interface da546174-0676-4332-8817-c51ed821f9d3; detaching it from the instance and deleting it from the info cache
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.network.neutron [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Updating instance_info_cache with network_info: [{"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquired lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.objects.instance [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] Lazy-loading 'system_metadata' on Instance uuid e3236316-dada-4aee-a210-6d9e9950c166 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.objects.instance [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] Lazy-loading 'flavor' on Instance uuid e3236316-dada-4aee-a210-6d9e9950c166 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237150177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237150177',id=23,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLqlkeW8K4/NYjRCJM4DThn3bJr4LmJGxj2R3Ahh8DNjzuZ9KWKu2ENvKunjOIly8U/grW0cxfrq3RvxlK8fCQ+TzP/dQAKgugcoqQDuK4pTxhnxyfh+UcCyNr/VbXPmw==',key_name='tempest-keypair-1386297183',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='334e1cae88394856b698916811059782',ramdisk_id='',reservation_id='r-kqjagab3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1067579941',owner_user_name='tempest-TaggedAttachmentsTest-1067579941-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1830f07ec8441a98454a18fd3a2e5a9',uuid=e3236316-dada-4aee-a210-6d9e9950c166,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] Converting VIF {"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:68,bridge_name='br-int',has_traffic_filtering=True,id=da546174-0676-4332-8817-c51ed821f9d3,network=Network(7ce71910-8122-4156-9895-ad9f81367011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda546174-06') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bf:b7:68"/><model type="virtio"/><mtu size="1442"/><target dev="tapda546174-06"/></interface> {{(pid=73520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bf:b7:68"/><model type="virtio"/><mtu size="1442"/><target dev="tapda546174-06"/></interface>not found in domain: <domain type='kvm' id='27'>
Aug 16 12:23:07 user nova-compute[73520]:   <name>instance-00000017</name>
Aug 16 12:23:07 user nova-compute[73520]:   <uuid>e3236316-dada-4aee-a210-6d9e9950c166</uuid>
Aug 16 12:23:07 user nova-compute[73520]:   <metadata>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:23:07 user nova-compute[73520]:   <nova:package version="0.0.0"/>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:name>tempest-device-tagging-server-1237150177</nova:name>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:creationTime>2023-08-16 12:23:06</nova:creationTime>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:flavor name="m1.tiny">
Aug 16 12:23:07 user nova-compute[73520]:     <nova:memory>512</nova:memory>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:disk>1</nova:disk>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:swap>0</nova:swap>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:vcpus>1</nova:vcpus>
Aug 16 12:23:07 user nova-compute[73520]:   </nova:flavor>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:owner>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:user uuid="d1830f07ec8441a98454a18fd3a2e5a9">tempest-TaggedAttachmentsTest-1067579941-project-member</nova:user>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:project uuid="334e1cae88394856b698916811059782">tempest-TaggedAttachmentsTest-1067579941</nova:project>
Aug 16 12:23:07 user nova-compute[73520]:   </nova:owner>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:ports>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:port uuid="7af832cf-a4a6-4c84-8ca3-0b578347bbc0">
Aug 16 12:23:07 user nova-compute[73520]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 12:23:07 user nova-compute[73520]:     </nova:port>
Aug 16 12:23:07 user nova-compute[73520]:   </nova:ports>
Aug 16 12:23:07 user nova-compute[73520]: </nova:instance>
Aug 16 12:23:07 user nova-compute[73520]:   </metadata>
Aug 16 12:23:07 user nova-compute[73520]:   <memory unit='KiB'>524288</memory>
Aug 16 12:23:07 user nova-compute[73520]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 12:23:07 user nova-compute[73520]:   <vcpu placement='static'>1</vcpu>
Aug 16 12:23:07 user nova-compute[73520]:   <resource>
Aug 16 12:23:07 user nova-compute[73520]:     <partition>/machine</partition>
Aug 16 12:23:07 user nova-compute[73520]:   </resource>
Aug 16 12:23:07 user nova-compute[73520]:   <sysinfo type='smbios'>
Aug 16 12:23:07 user nova-compute[73520]:     <system>
Aug 16 12:23:07 user nova-compute[73520]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 12:23:07 user nova-compute[73520]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 12:23:07 user nova-compute[73520]:       <entry name='version'>0.0.0</entry>
Aug 16 12:23:07 user nova-compute[73520]:       <entry name='serial'>e3236316-dada-4aee-a210-6d9e9950c166</entry>
Aug 16 12:23:07 user nova-compute[73520]:       <entry name='uuid'>e3236316-dada-4aee-a210-6d9e9950c166</entry>
Aug 16 12:23:07 user nova-compute[73520]:       <entry name='family'>Virtual Machine</entry>
Aug 16 12:23:07 user nova-compute[73520]:     </system>
Aug 16 12:23:07 user nova-compute[73520]:   </sysinfo>
Aug 16 12:23:07 user nova-compute[73520]:   <os>
Aug 16 12:23:07 user nova-compute[73520]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 12:23:07 user nova-compute[73520]:     <boot dev='hd'/>
Aug 16 12:23:07 user nova-compute[73520]:     <smbios mode='sysinfo'/>
Aug 16 12:23:07 user nova-compute[73520]:   </os>
Aug 16 12:23:07 user nova-compute[73520]:   <features>
Aug 16 12:23:07 user nova-compute[73520]:     <acpi/>
Aug 16 12:23:07 user nova-compute[73520]:     <apic/>
Aug 16 12:23:07 user nova-compute[73520]:     <vmcoreinfo state='on'/>
Aug 16 12:23:07 user nova-compute[73520]:   </features>
Aug 16 12:23:07 user nova-compute[73520]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 12:23:07 user nova-compute[73520]:     <model fallback='forbid'>Nehalem</model>
Aug 16 12:23:07 user nova-compute[73520]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 12:23:07 user nova-compute[73520]:     <feature policy='require' name='vme'/>
Aug 16 12:23:07 user nova-compute[73520]:     <feature policy='require' name='x2apic'/>
Aug 16 12:23:07 user nova-compute[73520]:     <feature policy='require' name='hypervisor'/>
Aug 16 12:23:07 user nova-compute[73520]:   </cpu>
Aug 16 12:23:07 user nova-compute[73520]:   <clock offset='utc'>
Aug 16 12:23:07 user nova-compute[73520]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 12:23:07 user nova-compute[73520]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 12:23:07 user nova-compute[73520]:     <timer name='hpet' present='no'/>
Aug 16 12:23:07 user nova-compute[73520]:   </clock>
Aug 16 12:23:07 user nova-compute[73520]:   <on_poweroff>destroy</on_poweroff>
Aug 16 12:23:07 user nova-compute[73520]:   <on_reboot>restart</on_reboot>
Aug 16 12:23:07 user nova-compute[73520]:   <on_crash>destroy</on_crash>
Aug 16 12:23:07 user nova-compute[73520]:   <devices>
Aug 16 12:23:07 user nova-compute[73520]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 12:23:07 user nova-compute[73520]:     <disk type='file' device='disk'>
Aug 16 12:23:07 user nova-compute[73520]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 12:23:07 user nova-compute[73520]:       <source file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk' index='2'/>
Aug 16 12:23:07 user nova-compute[73520]:       <backingStore type='file' index='3'>
Aug 16 12:23:07 user nova-compute[73520]:         <format type='raw'/>
Aug 16 12:23:07 user nova-compute[73520]:         <source file='/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61'/>
Aug 16 12:23:07 user nova-compute[73520]:         <backingStore/>
Aug 16 12:23:07 user nova-compute[73520]:       </backingStore>
Aug 16 12:23:07 user nova-compute[73520]:       <target dev='vda' bus='virtio'/>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='virtio-disk0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </disk>
Aug 16 12:23:07 user nova-compute[73520]:     <disk type='file' device='cdrom'>
Aug 16 12:23:07 user nova-compute[73520]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 12:23:07 user nova-compute[73520]:       <source file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk.config' index='1'/>
Aug 16 12:23:07 user nova-compute[73520]:       <backingStore/>
Aug 16 12:23:07 user nova-compute[73520]:       <target dev='hda' bus='ide'/>
Aug 16 12:23:07 user nova-compute[73520]:       <readonly/>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='ide0-0-0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </disk>
Aug 16 12:23:07 user nova-compute[73520]:     <controller type='usb' index='0' model='none'>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='usb'/>
Aug 16 12:23:07 user nova-compute[73520]:     </controller>
Aug 16 12:23:07 user nova-compute[73520]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='pci.0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </controller>
Aug 16 12:23:07 user nova-compute[73520]:     <controller type='ide' index='0'>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='ide'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 12:23:07 user nova-compute[73520]:     </controller>
Aug 16 12:23:07 user nova-compute[73520]:     <interface type='ethernet'>
Aug 16 12:23:07 user nova-compute[73520]:       <mac address='fa:16:3e:a1:f5:32'/>
Aug 16 12:23:07 user nova-compute[73520]:       <target dev='tap7af832cf-a4'/>
Aug 16 12:23:07 user nova-compute[73520]:       <model type='virtio'/>
Aug 16 12:23:07 user nova-compute[73520]:       <mtu size='1442'/>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='net0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </interface>
Aug 16 12:23:07 user nova-compute[73520]:     <serial type='pty'>
Aug 16 12:23:07 user nova-compute[73520]:       <source path='/dev/pts/0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <log file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/console.log' append='off'/>
Aug 16 12:23:07 user nova-compute[73520]:       <target type='isa-serial' port='0'>
Aug 16 12:23:07 user nova-compute[73520]:         <model name='isa-serial'/>
Aug 16 12:23:07 user nova-compute[73520]:       </target>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='serial0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </serial>
Aug 16 12:23:07 user nova-compute[73520]:     <console type='pty' tty='/dev/pts/0'>
Aug 16 12:23:07 user nova-compute[73520]:       <source path='/dev/pts/0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <log file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/console.log' append='off'/>
Aug 16 12:23:07 user nova-compute[73520]:       <target type='serial' port='0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='serial0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </console>
Aug 16 12:23:07 user nova-compute[73520]:     <input type='mouse' bus='ps2'>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='input0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </input>
Aug 16 12:23:07 user nova-compute[73520]:     <input type='keyboard' bus='ps2'>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='input1'/>
Aug 16 12:23:07 user nova-compute[73520]:     </input>
Aug 16 12:23:07 user nova-compute[73520]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Aug 16 12:23:07 user nova-compute[73520]:       <listen type='address' address='0.0.0.0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </graphics>
Aug 16 12:23:07 user nova-compute[73520]:     <audio id='1' type='none'/>
Aug 16 12:23:07 user nova-compute[73520]:     <video>
Aug 16 12:23:07 user nova-compute[73520]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='video0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </video>
Aug 16 12:23:07 user nova-compute[73520]:     <memballoon model='virtio'>
Aug 16 12:23:07 user nova-compute[73520]:       <stats period='10'/>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='balloon0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </memballoon>
Aug 16 12:23:07 user nova-compute[73520]:     <rng model='virtio'>
Aug 16 12:23:07 user nova-compute[73520]:       <backend model='random'>/dev/urandom</backend>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='rng0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </rng>
Aug 16 12:23:07 user nova-compute[73520]:   </devices>
Aug 16 12:23:07 user nova-compute[73520]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 12:23:07 user nova-compute[73520]:     <label>libvirt-e3236316-dada-4aee-a210-6d9e9950c166</label>
Aug 16 12:23:07 user nova-compute[73520]:     <imagelabel>libvirt-e3236316-dada-4aee-a210-6d9e9950c166</imagelabel>
Aug 16 12:23:07 user nova-compute[73520]:   </seclabel>
Aug 16 12:23:07 user nova-compute[73520]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 12:23:07 user nova-compute[73520]:     <label>+64055:+108</label>
Aug 16 12:23:07 user nova-compute[73520]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 12:23:07 user nova-compute[73520]:   </seclabel>
Aug 16 12:23:07 user nova-compute[73520]: </domain>
Aug 16 12:23:07 user nova-compute[73520]:  {{(pid=73520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bf:b7:68"/><model type="virtio"/><mtu size="1442"/><target dev="tapda546174-06"/></interface> {{(pid=73520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bf:b7:68"/><model type="virtio"/><mtu size="1442"/><target dev="tapda546174-06"/></interface>not found in domain: <domain type='kvm' id='27'>
Aug 16 12:23:07 user nova-compute[73520]:   <name>instance-00000017</name>
Aug 16 12:23:07 user nova-compute[73520]:   <uuid>e3236316-dada-4aee-a210-6d9e9950c166</uuid>
Aug 16 12:23:07 user nova-compute[73520]:   <metadata>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:23:07 user nova-compute[73520]:   <nova:package version="0.0.0"/>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:name>tempest-device-tagging-server-1237150177</nova:name>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:creationTime>2023-08-16 12:23:06</nova:creationTime>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:flavor name="m1.tiny">
Aug 16 12:23:07 user nova-compute[73520]:     <nova:memory>512</nova:memory>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:disk>1</nova:disk>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:swap>0</nova:swap>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:vcpus>1</nova:vcpus>
Aug 16 12:23:07 user nova-compute[73520]:   </nova:flavor>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:owner>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:user uuid="d1830f07ec8441a98454a18fd3a2e5a9">tempest-TaggedAttachmentsTest-1067579941-project-member</nova:user>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:project uuid="334e1cae88394856b698916811059782">tempest-TaggedAttachmentsTest-1067579941</nova:project>
Aug 16 12:23:07 user nova-compute[73520]:   </nova:owner>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:ports>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:port uuid="7af832cf-a4a6-4c84-8ca3-0b578347bbc0">
Aug 16 12:23:07 user nova-compute[73520]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 12:23:07 user nova-compute[73520]:     </nova:port>
Aug 16 12:23:07 user nova-compute[73520]:   </nova:ports>
Aug 16 12:23:07 user nova-compute[73520]: </nova:instance>
Aug 16 12:23:07 user nova-compute[73520]:   </metadata>
Aug 16 12:23:07 user nova-compute[73520]:   <memory unit='KiB'>524288</memory>
Aug 16 12:23:07 user nova-compute[73520]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 12:23:07 user nova-compute[73520]:   <vcpu placement='static'>1</vcpu>
Aug 16 12:23:07 user nova-compute[73520]:   <resource>
Aug 16 12:23:07 user nova-compute[73520]:     <partition>/machine</partition>
Aug 16 12:23:07 user nova-compute[73520]:   </resource>
Aug 16 12:23:07 user nova-compute[73520]:   <sysinfo type='smbios'>
Aug 16 12:23:07 user nova-compute[73520]:     <system>
Aug 16 12:23:07 user nova-compute[73520]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 12:23:07 user nova-compute[73520]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 12:23:07 user nova-compute[73520]:       <entry name='version'>0.0.0</entry>
Aug 16 12:23:07 user nova-compute[73520]:       <entry name='serial'>e3236316-dada-4aee-a210-6d9e9950c166</entry>
Aug 16 12:23:07 user nova-compute[73520]:       <entry name='uuid'>e3236316-dada-4aee-a210-6d9e9950c166</entry>
Aug 16 12:23:07 user nova-compute[73520]:       <entry name='family'>Virtual Machine</entry>
Aug 16 12:23:07 user nova-compute[73520]:     </system>
Aug 16 12:23:07 user nova-compute[73520]:   </sysinfo>
Aug 16 12:23:07 user nova-compute[73520]:   <os>
Aug 16 12:23:07 user nova-compute[73520]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 12:23:07 user nova-compute[73520]:     <boot dev='hd'/>
Aug 16 12:23:07 user nova-compute[73520]:     <smbios mode='sysinfo'/>
Aug 16 12:23:07 user nova-compute[73520]:   </os>
Aug 16 12:23:07 user nova-compute[73520]:   <features>
Aug 16 12:23:07 user nova-compute[73520]:     <acpi/>
Aug 16 12:23:07 user nova-compute[73520]:     <apic/>
Aug 16 12:23:07 user nova-compute[73520]:     <vmcoreinfo state='on'/>
Aug 16 12:23:07 user nova-compute[73520]:   </features>
Aug 16 12:23:07 user nova-compute[73520]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 12:23:07 user nova-compute[73520]:     <model fallback='forbid'>Nehalem</model>
Aug 16 12:23:07 user nova-compute[73520]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 12:23:07 user nova-compute[73520]:     <feature policy='require' name='vme'/>
Aug 16 12:23:07 user nova-compute[73520]:     <feature policy='require' name='x2apic'/>
Aug 16 12:23:07 user nova-compute[73520]:     <feature policy='require' name='hypervisor'/>
Aug 16 12:23:07 user nova-compute[73520]:   </cpu>
Aug 16 12:23:07 user nova-compute[73520]:   <clock offset='utc'>
Aug 16 12:23:07 user nova-compute[73520]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 12:23:07 user nova-compute[73520]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 12:23:07 user nova-compute[73520]:     <timer name='hpet' present='no'/>
Aug 16 12:23:07 user nova-compute[73520]:   </clock>
Aug 16 12:23:07 user nova-compute[73520]:   <on_poweroff>destroy</on_poweroff>
Aug 16 12:23:07 user nova-compute[73520]:   <on_reboot>restart</on_reboot>
Aug 16 12:23:07 user nova-compute[73520]:   <on_crash>destroy</on_crash>
Aug 16 12:23:07 user nova-compute[73520]:   <devices>
Aug 16 12:23:07 user nova-compute[73520]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 12:23:07 user nova-compute[73520]:     <disk type='file' device='disk'>
Aug 16 12:23:07 user nova-compute[73520]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 12:23:07 user nova-compute[73520]:       <source file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk' index='2'/>
Aug 16 12:23:07 user nova-compute[73520]:       <backingStore type='file' index='3'>
Aug 16 12:23:07 user nova-compute[73520]:         <format type='raw'/>
Aug 16 12:23:07 user nova-compute[73520]:         <source file='/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61'/>
Aug 16 12:23:07 user nova-compute[73520]:         <backingStore/>
Aug 16 12:23:07 user nova-compute[73520]:       </backingStore>
Aug 16 12:23:07 user nova-compute[73520]:       <target dev='vda' bus='virtio'/>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='virtio-disk0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </disk>
Aug 16 12:23:07 user nova-compute[73520]:     <disk type='file' device='cdrom'>
Aug 16 12:23:07 user nova-compute[73520]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 12:23:07 user nova-compute[73520]:       <source file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk.config' index='1'/>
Aug 16 12:23:07 user nova-compute[73520]:       <backingStore/>
Aug 16 12:23:07 user nova-compute[73520]:       <target dev='hda' bus='ide'/>
Aug 16 12:23:07 user nova-compute[73520]:       <readonly/>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='ide0-0-0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </disk>
Aug 16 12:23:07 user nova-compute[73520]:     <controller type='usb' index='0' model='none'>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='usb'/>
Aug 16 12:23:07 user nova-compute[73520]:     </controller>
Aug 16 12:23:07 user nova-compute[73520]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='pci.0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </controller>
Aug 16 12:23:07 user nova-compute[73520]:     <controller type='ide' index='0'>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='ide'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 12:23:07 user nova-compute[73520]:     </controller>
Aug 16 12:23:07 user nova-compute[73520]:     <interface type='ethernet'>
Aug 16 12:23:07 user nova-compute[73520]:       <mac address='fa:16:3e:a1:f5:32'/>
Aug 16 12:23:07 user nova-compute[73520]:       <target dev='tap7af832cf-a4'/>
Aug 16 12:23:07 user nova-compute[73520]:       <model type='virtio'/>
Aug 16 12:23:07 user nova-compute[73520]:       <mtu size='1442'/>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='net0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </interface>
Aug 16 12:23:07 user nova-compute[73520]:     <serial type='pty'>
Aug 16 12:23:07 user nova-compute[73520]:       <source path='/dev/pts/0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <log file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/console.log' append='off'/>
Aug 16 12:23:07 user nova-compute[73520]:       <target type='isa-serial' port='0'>
Aug 16 12:23:07 user nova-compute[73520]:         <model name='isa-serial'/>
Aug 16 12:23:07 user nova-compute[73520]:       </target>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='serial0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </serial>
Aug 16 12:23:07 user nova-compute[73520]:     <console type='pty' tty='/dev/pts/0'>
Aug 16 12:23:07 user nova-compute[73520]:       <source path='/dev/pts/0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <log file='/opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/console.log' append='off'/>
Aug 16 12:23:07 user nova-compute[73520]:       <target type='serial' port='0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='serial0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </console>
Aug 16 12:23:07 user nova-compute[73520]:     <input type='mouse' bus='ps2'>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='input0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </input>
Aug 16 12:23:07 user nova-compute[73520]:     <input type='keyboard' bus='ps2'>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='input1'/>
Aug 16 12:23:07 user nova-compute[73520]:     </input>
Aug 16 12:23:07 user nova-compute[73520]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Aug 16 12:23:07 user nova-compute[73520]:       <listen type='address' address='0.0.0.0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </graphics>
Aug 16 12:23:07 user nova-compute[73520]:     <audio id='1' type='none'/>
Aug 16 12:23:07 user nova-compute[73520]:     <video>
Aug 16 12:23:07 user nova-compute[73520]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='video0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </video>
Aug 16 12:23:07 user nova-compute[73520]:     <memballoon model='virtio'>
Aug 16 12:23:07 user nova-compute[73520]:       <stats period='10'/>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='balloon0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </memballoon>
Aug 16 12:23:07 user nova-compute[73520]:     <rng model='virtio'>
Aug 16 12:23:07 user nova-compute[73520]:       <backend model='random'>/dev/urandom</backend>
Aug 16 12:23:07 user nova-compute[73520]:       <alias name='rng0'/>
Aug 16 12:23:07 user nova-compute[73520]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 12:23:07 user nova-compute[73520]:     </rng>
Aug 16 12:23:07 user nova-compute[73520]:   </devices>
Aug 16 12:23:07 user nova-compute[73520]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 12:23:07 user nova-compute[73520]:     <label>libvirt-e3236316-dada-4aee-a210-6d9e9950c166</label>
Aug 16 12:23:07 user nova-compute[73520]:     <imagelabel>libvirt-e3236316-dada-4aee-a210-6d9e9950c166</imagelabel>
Aug 16 12:23:07 user nova-compute[73520]:   </seclabel>
Aug 16 12:23:07 user nova-compute[73520]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 12:23:07 user nova-compute[73520]:     <label>+64055:+108</label>
Aug 16 12:23:07 user nova-compute[73520]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 12:23:07 user nova-compute[73520]:   </seclabel>
Aug 16 12:23:07 user nova-compute[73520]: </domain>
Aug 16 12:23:07 user nova-compute[73520]:  {{(pid=73520) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 12:23:07 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Detaching interface fa:16:3e:bf:b7:68 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapda546174-06' not found.
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237150177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237150177',id=23,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLqlkeW8K4/NYjRCJM4DThn3bJr4LmJGxj2R3Ahh8DNjzuZ9KWKu2ENvKunjOIly8U/grW0cxfrq3RvxlK8fCQ+TzP/dQAKgugcoqQDuK4pTxhnxyfh+UcCyNr/VbXPmw==',key_name='tempest-keypair-1386297183',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='334e1cae88394856b698916811059782',ramdisk_id='',reservation_id='r-kqjagab3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1067579941',owner_user_name='tempest-TaggedAttachmentsTest-1067579941-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1830f07ec8441a98454a18fd3a2e5a9',uuid=e3236316-dada-4aee-a210-6d9e9950c166,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] Converting VIF {"id": "da546174-0676-4332-8817-c51ed821f9d3", "address": "fa:16:3e:bf:b7:68", "network": {"id": "7ce71910-8122-4156-9895-ad9f81367011", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1976080525", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda546174-06", "ovs_interfaceid": "da546174-0676-4332-8817-c51ed821f9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:68,bridge_name='br-int',has_traffic_filtering=True,id=da546174-0676-4332-8817-c51ed821f9d3,network=Network(7ce71910-8122-4156-9895-ad9f81367011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda546174-06') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG os_vif [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:68,bridge_name='br-int',has_traffic_filtering=True,id=da546174-0676-4332-8817-c51ed821f9d3,network=Network(7ce71910-8122-4156-9895-ad9f81367011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda546174-06') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda546174-06, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:23:07 user nova-compute[73520]: INFO os_vif [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:68,bridge_name='br-int',has_traffic_filtering=True,id=da546174-0676-4332-8817-c51ed821f9d3,network=Network(7ce71910-8122-4156-9895-ad9f81367011),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda546174-06')
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [req-6b0f2d4d-d4ae-4577-9802-efed99d0b34b req-5119e8eb-c788-4ba6-9c9f-2cf6161a9b1b service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:23:07 user nova-compute[73520]:   <nova:package version="0.0.0"/>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:name>tempest-device-tagging-server-1237150177</nova:name>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:creationTime>2023-08-16 12:23:07</nova:creationTime>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:flavor name="m1.tiny">
Aug 16 12:23:07 user nova-compute[73520]:     <nova:memory>512</nova:memory>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:disk>1</nova:disk>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:swap>0</nova:swap>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:vcpus>1</nova:vcpus>
Aug 16 12:23:07 user nova-compute[73520]:   </nova:flavor>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:owner>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:user uuid="d1830f07ec8441a98454a18fd3a2e5a9">tempest-TaggedAttachmentsTest-1067579941-project-member</nova:user>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:project uuid="334e1cae88394856b698916811059782">tempest-TaggedAttachmentsTest-1067579941</nova:project>
Aug 16 12:23:07 user nova-compute[73520]:   </nova:owner>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:23:07 user nova-compute[73520]:   <nova:ports>
Aug 16 12:23:07 user nova-compute[73520]:     <nova:port uuid="7af832cf-a4a6-4c84-8ca3-0b578347bbc0">
Aug 16 12:23:07 user nova-compute[73520]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 12:23:07 user nova-compute[73520]:     </nova:port>
Aug 16 12:23:07 user nova-compute[73520]:   </nova:ports>
Aug 16 12:23:07 user nova-compute[73520]: </nova:instance>
Aug 16 12:23:07 user nova-compute[73520]:  {{(pid=73520) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Updating instance_info_cache with network_info: [{"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:23:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Releasing lock "refresh_cache-e3236316-dada-4aee-a210-6d9e9950c166" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:23:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-54401676-367a-49ae-ace2-470adc609d03 tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "interface-e3236316-dada-4aee-a210-6d9e9950c166-da546174-0676-4332-8817-c51ed821f9d3" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.579s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-e711b3cb-7a79-4b87-83c2-6c5e79aedf13 req-b00cc011-c07d-4e71-94a6-7b8ea74029bc service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-plugged-da546174-0676-4332-8817-c51ed821f9d3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e711b3cb-7a79-4b87-83c2-6c5e79aedf13 req-b00cc011-c07d-4e71-94a6-7b8ea74029bc service nova] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e711b3cb-7a79-4b87-83c2-6c5e79aedf13 req-b00cc011-c07d-4e71-94a6-7b8ea74029bc service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e711b3cb-7a79-4b87-83c2-6c5e79aedf13 req-b00cc011-c07d-4e71-94a6-7b8ea74029bc service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-e711b3cb-7a79-4b87-83c2-6c5e79aedf13 req-b00cc011-c07d-4e71-94a6-7b8ea74029bc service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] No waiting events found dispatching network-vif-plugged-da546174-0676-4332-8817-c51ed821f9d3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:09 user nova-compute[73520]: WARNING nova.compute.manager [req-e711b3cb-7a79-4b87-83c2-6c5e79aedf13 req-b00cc011-c07d-4e71-94a6-7b8ea74029bc service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received unexpected event network-vif-plugged-da546174-0676-4332-8817-c51ed821f9d3 for instance with vm_state active and task_state None.
Aug 16 12:23:10 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188575.2492833, 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:23:10 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] VM Stopped (Lifecycle Event)
Aug 16 12:23:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cabf0bc7-6dbf-4ea1-9345-fb60d5b8e079 None None] [instance: 2e0f366b-6e25-44a3-91a8-5bcfa0a701bb] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:23:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "9ab085c8-d666-4525-bee5-d61aada89a7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:20 user nova-compute[73520]: INFO nova.compute.manager [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Detaching volume 83583c58-4e44-4aee-85a7-a6f5f86ed899
Aug 16 12:23:20 user nova-compute[73520]: INFO nova.virt.block_device [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Attempting to driver detach volume 83583c58-4e44-4aee-85a7-a6f5f86ed899 from mountpoint /dev/vdb
Aug 16 12:23:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Attempting to detach device vdb from instance 9ab085c8-d666-4525-bee5-d61aada89a7a from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:23:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:23:20 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:23:20 user nova-compute[73520]:   <source dev="/dev/sdd"/>
Aug 16 12:23:20 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:23:20 user nova-compute[73520]:   <serial>83583c58-4e44-4aee-85a7-a6f5f86ed899</serial>
Aug 16 12:23:20 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:23:20 user nova-compute[73520]: </disk>
Aug 16 12:23:20 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:23:20 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Successfully detached device vdb from instance 9ab085c8-d666-4525-bee5-d61aada89a7a from the persistent domain config.
Aug 16 12:23:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ab085c8-d666-4525-bee5-d61aada89a7a from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:23:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:23:20 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:23:20 user nova-compute[73520]:   <source dev="/dev/sdd"/>
Aug 16 12:23:20 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:23:20 user nova-compute[73520]:   <serial>83583c58-4e44-4aee-85a7-a6f5f86ed899</serial>
Aug 16 12:23:20 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:23:20 user nova-compute[73520]: </disk>
Aug 16 12:23:20 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188601.0130663, 9ab085c8-d666-4525-bee5-d61aada89a7a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ab085c8-d666-4525-bee5-d61aada89a7a {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:23:21 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Successfully detached device vdb from instance 9ab085c8-d666-4525-bee5-d61aada89a7a from the live domain config.
Aug 16 12:23:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgEabRie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:23:21 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f3747c-6e35-465a-827b-eaa30211a6ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c426313a-a6ae-4b17-ab0f-8030b3875657]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:23:21 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:23:21 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:23:21 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:23:21 user nova-compute[73520]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 (non-flash)
Aug 16 12:23:21 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:23:21 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c691d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899'): ({'sdd'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Removing single pathed devices sdd {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[78709dcf-c35b-4fac-8e3f-d01bdd089e07]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd915abb-5c04-4863-8105-f94cf58cdf68]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Flushing IO for device /dev/sdd {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a3af81-d058-48ee-acd4-c2123621d561]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b2a683-ac8b-415a-81f7-4b3bce28a611]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] SCSI volumes sdd have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[580e9e00-2c7f-48cb-b496-3a4796b30c3f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04071f6-9590-446a-ad5e-ed70b9a80f50]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899, portal: 172.16.0.220,3260]
Aug 16 12:23:21 user nova-compute[73520]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899, portal: 172.16.0.220,3260] successful.
Aug 16 12:23:21 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83583c58-4e44-4aee-85a7-a6f5f86ed899 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6486b561-c022-489c-b09a-e04f7f10a2eb]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] <== disconnect_volume: return (288ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:23:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lazy-loading 'flavor' on Instance uuid 9ab085c8-d666-4525-bee5-d61aada89a7a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ec3bae65-10f9-4f99-ac1b-f5869fa4f055 tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.679s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:23 user nova-compute[73520]: INFO nova.compute.manager [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Rescuing
Aug 16 12:23:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:23:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquired lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:23:23 user nova-compute[73520]: DEBUG nova.network.neutron [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:23:24 user nova-compute[73520]: DEBUG nova.network.neutron [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Updating instance_info_cache with network_info: [{"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:23:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Releasing lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:23:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-0d35875a-ec03-411b-9ac3-963db08ef007 req-1937ac87-e8d3-4c0a-ab12-fc441bd84db6 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received event network-vif-unplugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0d35875a-ec03-411b-9ac3-963db08ef007 req-1937ac87-e8d3-4c0a-ab12-fc441bd84db6 service nova] Acquiring lock "4926037c-8e89-4923-940f-9837b053b9a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0d35875a-ec03-411b-9ac3-963db08ef007 req-1937ac87-e8d3-4c0a-ab12-fc441bd84db6 service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0d35875a-ec03-411b-9ac3-963db08ef007 req-1937ac87-e8d3-4c0a-ab12-fc441bd84db6 service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-0d35875a-ec03-411b-9ac3-963db08ef007 req-1937ac87-e8d3-4c0a-ab12-fc441bd84db6 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] No waiting events found dispatching network-vif-unplugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:24 user nova-compute[73520]: WARNING nova.compute.manager [req-0d35875a-ec03-411b-9ac3-963db08ef007 req-1937ac87-e8d3-4c0a-ab12-fc441bd84db6 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received unexpected event network-vif-unplugged-78cef49e-d317-4d37-8da3-d72d0b755c2d for instance with vm_state active and task_state rescuing.
Aug 16 12:23:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:25 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Instance destroyed successfully.
Aug 16 12:23:25 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Attempting rescue
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73520) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Instance directory exists: not creating {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 12:23:25 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Creating image(s)
Aug 16 12:23:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "/opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "/opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "/opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4926037c-8e89-4923-940f-9837b053b9a0 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue" returned: 0 in 0.050s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'migration_context' on Instance uuid 4926037c-8e89-4923-940f-9837b053b9a0 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Start _get_guest_xml network_info=[{"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "vif_mac": "fa:16:3e:a8:58:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'resources' on Instance uuid 4926037c-8e89-4923-940f-9837b053b9a0 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'numa_topology' on Instance uuid 4926037c-8e89-4923-940f-9837b053b9a0 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:25 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:23:25 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4926037c-8e89-4923-940f-9837b053b9a0 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-978581289',display_name='tempest-ServerRescueNegativeTestJSON-server-978581289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-978581289',id=26,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:21:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930fb7964e2942c88c3416be172c6884',ramdisk_id='',reservation_id='r-gkbk7dsy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-863509458',owner_user_name='tempest-ServerRescueNegativeTestJSON-863509458-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:21:45Z,user_data=None,user_id='0d351d0adad3463ebb2e6917a5f91920',uuid=4926037c-8e89-4923-940f-9837b053b9a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "vif_mac": "fa:16:3e:a8:58:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converting VIF {"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "vif_mac": "fa:16:3e:a8:58:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:58:db,bridge_name='br-int',has_traffic_filtering=True,id=78cef49e-d317-4d37-8da3-d72d0b755c2d,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78cef49e-d3') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'pci_devices' on Instance uuid 4926037c-8e89-4923-940f-9837b053b9a0 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:23:25 user nova-compute[73520]:   <uuid>4926037c-8e89-4923-940f-9837b053b9a0</uuid>
Aug 16 12:23:25 user nova-compute[73520]:   <name>instance-0000001a</name>
Aug 16 12:23:25 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:23:25 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:23:25 user nova-compute[73520]:   <metadata>
Aug 16 12:23:25 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:23:25 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:23:25 user nova-compute[73520]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-978581289</nova:name>
Aug 16 12:23:25 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:23:25</nova:creationTime>
Aug 16 12:23:25 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:23:25 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:23:25 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:23:25 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:23:25 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:23:25 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:23:25 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:23:25 user nova-compute[73520]:       <nova:owner>
Aug 16 12:23:25 user nova-compute[73520]:         <nova:user uuid="0d351d0adad3463ebb2e6917a5f91920">tempest-ServerRescueNegativeTestJSON-863509458-project-member</nova:user>
Aug 16 12:23:25 user nova-compute[73520]:         <nova:project uuid="930fb7964e2942c88c3416be172c6884">tempest-ServerRescueNegativeTestJSON-863509458</nova:project>
Aug 16 12:23:25 user nova-compute[73520]:       </nova:owner>
Aug 16 12:23:25 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:23:25 user nova-compute[73520]:       <nova:ports>
Aug 16 12:23:25 user nova-compute[73520]:         <nova:port uuid="78cef49e-d317-4d37-8da3-d72d0b755c2d">
Aug 16 12:23:25 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 12:23:25 user nova-compute[73520]:         </nova:port>
Aug 16 12:23:25 user nova-compute[73520]:       </nova:ports>
Aug 16 12:23:25 user nova-compute[73520]:     </nova:instance>
Aug 16 12:23:25 user nova-compute[73520]:   </metadata>
Aug 16 12:23:25 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:23:25 user nova-compute[73520]:     <system>
Aug 16 12:23:25 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:23:25 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:23:25 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:23:25 user nova-compute[73520]:       <entry name="serial">4926037c-8e89-4923-940f-9837b053b9a0</entry>
Aug 16 12:23:25 user nova-compute[73520]:       <entry name="uuid">4926037c-8e89-4923-940f-9837b053b9a0</entry>
Aug 16 12:23:25 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:23:25 user nova-compute[73520]:     </system>
Aug 16 12:23:25 user nova-compute[73520]:   </sysinfo>
Aug 16 12:23:25 user nova-compute[73520]:   <os>
Aug 16 12:23:25 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:23:25 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:23:25 user nova-compute[73520]:   </os>
Aug 16 12:23:25 user nova-compute[73520]:   <features>
Aug 16 12:23:25 user nova-compute[73520]:     <acpi/>
Aug 16 12:23:25 user nova-compute[73520]:     <apic/>
Aug 16 12:23:25 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:23:25 user nova-compute[73520]:   </features>
Aug 16 12:23:25 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:23:25 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:23:25 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:23:25 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:23:25 user nova-compute[73520]:   </clock>
Aug 16 12:23:25 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:23:25 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:23:25 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:23:25 user nova-compute[73520]:   </cpu>
Aug 16 12:23:25 user nova-compute[73520]:   <devices>
Aug 16 12:23:25 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:23:25 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:23:25 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue"/>
Aug 16 12:23:25 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:23:25 user nova-compute[73520]:     </disk>
Aug 16 12:23:25 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:23:25 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:23:25 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk"/>
Aug 16 12:23:25 user nova-compute[73520]:       <target dev="vdb" bus="virtio"/>
Aug 16 12:23:25 user nova-compute[73520]:     </disk>
Aug 16 12:23:25 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:23:25 user nova-compute[73520]:       <mac address="fa:16:3e:a8:58:db"/>
Aug 16 12:23:25 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:23:25 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:23:25 user nova-compute[73520]:       <target dev="tap78cef49e-d3"/>
Aug 16 12:23:25 user nova-compute[73520]:     </interface>
Aug 16 12:23:25 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:23:25 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/console.log" append="off"/>
Aug 16 12:23:25 user nova-compute[73520]:     </serial>
Aug 16 12:23:25 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:23:25 user nova-compute[73520]:     <video>
Aug 16 12:23:25 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:23:25 user nova-compute[73520]:     </video>
Aug 16 12:23:25 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:23:25 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:23:25 user nova-compute[73520]:     </rng>
Aug 16 12:23:25 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:23:25 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:23:25 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:23:25 user nova-compute[73520]:     </memballoon>
Aug 16 12:23:25 user nova-compute[73520]:   </devices>
Aug 16 12:23:25 user nova-compute[73520]: </domain>
Aug 16 12:23:25 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:23:25 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Instance destroyed successfully.
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:23:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No VIF found with MAC fa:16:3e:a8:58:db, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:23:26 user nova-compute[73520]: DEBUG nova.compute.manager [req-0af99628-916e-4ef7-bbc5-542b221b7c5d req-266459dd-7283-441b-afb5-8d3926602f1e service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received event network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0af99628-916e-4ef7-bbc5-542b221b7c5d req-266459dd-7283-441b-afb5-8d3926602f1e service nova] Acquiring lock "4926037c-8e89-4923-940f-9837b053b9a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0af99628-916e-4ef7-bbc5-542b221b7c5d req-266459dd-7283-441b-afb5-8d3926602f1e service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0af99628-916e-4ef7-bbc5-542b221b7c5d req-266459dd-7283-441b-afb5-8d3926602f1e service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:26 user nova-compute[73520]: DEBUG nova.compute.manager [req-0af99628-916e-4ef7-bbc5-542b221b7c5d req-266459dd-7283-441b-afb5-8d3926602f1e service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] No waiting events found dispatching network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:26 user nova-compute[73520]: WARNING nova.compute.manager [req-0af99628-916e-4ef7-bbc5-542b221b7c5d req-266459dd-7283-441b-afb5-8d3926602f1e service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received unexpected event network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d for instance with vm_state active and task_state rescuing.
Aug 16 12:23:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-d37c96b6-9729-43ed-93a2-2899534bb733 req-0bea52c8-f351-45bc-911c-6132777260b4 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received event network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d37c96b6-9729-43ed-93a2-2899534bb733 req-0bea52c8-f351-45bc-911c-6132777260b4 service nova] Acquiring lock "4926037c-8e89-4923-940f-9837b053b9a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d37c96b6-9729-43ed-93a2-2899534bb733 req-0bea52c8-f351-45bc-911c-6132777260b4 service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d37c96b6-9729-43ed-93a2-2899534bb733 req-0bea52c8-f351-45bc-911c-6132777260b4 service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-d37c96b6-9729-43ed-93a2-2899534bb733 req-0bea52c8-f351-45bc-911c-6132777260b4 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] No waiting events found dispatching network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:28 user nova-compute[73520]: WARNING nova.compute.manager [req-d37c96b6-9729-43ed-93a2-2899534bb733 req-0bea52c8-f351-45bc-911c-6132777260b4 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received unexpected event network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d for instance with vm_state active and task_state rescuing.
Aug 16 12:23:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-d37c96b6-9729-43ed-93a2-2899534bb733 req-0bea52c8-f351-45bc-911c-6132777260b4 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received event network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d37c96b6-9729-43ed-93a2-2899534bb733 req-0bea52c8-f351-45bc-911c-6132777260b4 service nova] Acquiring lock "4926037c-8e89-4923-940f-9837b053b9a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d37c96b6-9729-43ed-93a2-2899534bb733 req-0bea52c8-f351-45bc-911c-6132777260b4 service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d37c96b6-9729-43ed-93a2-2899534bb733 req-0bea52c8-f351-45bc-911c-6132777260b4 service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-d37c96b6-9729-43ed-93a2-2899534bb733 req-0bea52c8-f351-45bc-911c-6132777260b4 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] No waiting events found dispatching network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:28 user nova-compute[73520]: WARNING nova.compute.manager [req-d37c96b6-9729-43ed-93a2-2899534bb733 req-0bea52c8-f351-45bc-911c-6132777260b4 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received unexpected event network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d for instance with vm_state active and task_state rescuing.
Aug 16 12:23:28 user nova-compute[73520]: INFO nova.compute.manager [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Rescuing
Aug 16 12:23:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:23:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquired lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:23:28 user nova-compute[73520]: DEBUG nova.network.neutron [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:23:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Removed pending event for 4926037c-8e89-4923-940f-9837b053b9a0 due to event {{(pid=73520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 12:23:29 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188609.1189349, 4926037c-8e89-4923-940f-9837b053b9a0 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:23:29 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] VM Resumed (Lifecycle Event)
Aug 16 12:23:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-9c79f7f8-a440-4581-aaa3-14ce914a9320 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:23:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:23:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:23:29 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 12:23:29 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188609.1200917, 4926037c-8e89-4923-940f-9837b053b9a0 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:23:29 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] VM Started (Lifecycle Event)
Aug 16 12:23:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:23:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:23:29 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 12:23:29 user nova-compute[73520]: DEBUG nova.network.neutron [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Updating instance_info_cache with network_info: [{"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:23:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Releasing lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:23:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-b897d8e6-04ec-4e33-94c0-ef1f178e9e3f req-22a56103-0526-4f53-8612-de6d3fdd4a55 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-unplugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b897d8e6-04ec-4e33-94c0-ef1f178e9e3f req-22a56103-0526-4f53-8612-de6d3fdd4a55 service nova] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b897d8e6-04ec-4e33-94c0-ef1f178e9e3f req-22a56103-0526-4f53-8612-de6d3fdd4a55 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b897d8e6-04ec-4e33-94c0-ef1f178e9e3f req-22a56103-0526-4f53-8612-de6d3fdd4a55 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-b897d8e6-04ec-4e33-94c0-ef1f178e9e3f req-22a56103-0526-4f53-8612-de6d3fdd4a55 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] No waiting events found dispatching network-vif-unplugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:30 user nova-compute[73520]: WARNING nova.compute.manager [req-b897d8e6-04ec-4e33-94c0-ef1f178e9e3f req-22a56103-0526-4f53-8612-de6d3fdd4a55 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received unexpected event network-vif-unplugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b for instance with vm_state active and task_state rescuing.
Aug 16 12:23:30 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Instance destroyed successfully.
Aug 16 12:23:30 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Attempting a stable device rescue
Aug 16 12:23:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73520) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 12:23:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Instance directory exists: not creating {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 12:23:30 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Creating image(s)
Aug 16 12:23:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "/opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "/opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:30 user nova-compute[73520]: DEBUG nova.objects.instance [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'trusted_certs' on Instance uuid ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "108ecb3f0d8273983aabdb39f0d0d15fd915e000" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "108ecb3f0d8273983aabdb39f0d0d15fd915e000" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000.part --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:31 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000.part --force-share --output=json" returned: 0 in 0.208s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG nova.virt.images [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] 89561aae-36bd-4117-82b8-24b08b3e73e4 was qcow2, converting to raw {{(pid=73520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000.part /opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000.converted {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG nova.compute.manager [req-ccee7fbc-bd76-49f8-8f22-6ca2dae3a393 req-b93ccd41-4825-416c-8d27-b397f4cb5fa2 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ccee7fbc-bd76-49f8-8f22-6ca2dae3a393 req-b93ccd41-4825-416c-8d27-b397f4cb5fa2 service nova] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ccee7fbc-bd76-49f8-8f22-6ca2dae3a393 req-b93ccd41-4825-416c-8d27-b397f4cb5fa2 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ccee7fbc-bd76-49f8-8f22-6ca2dae3a393 req-b93ccd41-4825-416c-8d27-b397f4cb5fa2 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG nova.compute.manager [req-ccee7fbc-bd76-49f8-8f22-6ca2dae3a393 req-b93ccd41-4825-416c-8d27-b397f4cb5fa2 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] No waiting events found dispatching network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:32 user nova-compute[73520]: WARNING nova.compute.manager [req-ccee7fbc-bd76-49f8-8f22-6ca2dae3a393 req-b93ccd41-4825-416c-8d27-b397f4cb5fa2 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received unexpected event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b for instance with vm_state active and task_state rescuing.
Aug 16 12:23:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000.part /opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000.converted" returned: 0 in 0.576s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000.converted --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "108ecb3f0d8273983aabdb39f0d0d15fd915e000" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.273s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "108ecb3f0d8273983aabdb39f0d0d15fd915e000" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "108ecb3f0d8273983aabdb39f0d0d15fd915e000" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:32 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000 --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000,backing_fmt=raw /opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.rescue {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000,backing_fmt=raw /opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.rescue" returned: 0 in 0.053s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "108ecb3f0d8273983aabdb39f0d0d15fd915e000" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.objects.instance [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'migration_context' on Instance uuid ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Start _get_guest_xml network_info=[{"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "vif_mac": "fa:16:3e:79:4b:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '89561aae-36bd-4117-82b8-24b08b3e73e4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKbLeqTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'ba7e17f9-c32c-425d-a1ae-3e2cf9c44752', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6d21150-539b-46cc-a671-ba0feeef3c7c', 'serial': 'd6d21150-539b-46cc-a671-ba0feeef3c7c'}, 'attachment_id': '5736cb09-9187-493f-81c6-ae9b1247a4a3', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.objects.instance [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'resources' on Instance uuid ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.objects.instance [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'numa_topology' on Instance uuid ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:33 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:23:33 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.objects.instance [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKbLeqTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:23:33 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:23:33 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:23:33 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[660d67ed-5dc8-4da3-893a-f512dfaf4110]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = iKbLeqTJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 12:23:33 user nova-compute[73520]: node.name = iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c
Aug 16 12:23:33 user nova-compute[73520]: node.tpgt = -1
Aug 16 12:23:33 user nova-compute[73520]: node.startup = automatic
Aug 16 12:23:33 user nova-compute[73520]: node.leading_login = No
Aug 16 12:23:33 user nova-compute[73520]: iface.iscsi_ifacename = default
Aug 16 12:23:33 user nova-compute[73520]: iface.net_ifacename = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.ipaddress = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.prefix_len = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.hwaddress = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.transport_name = tcp
Aug 16 12:23:33 user nova-compute[73520]: iface.initiatorname = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.state = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.vlan_id = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.vlan_priority = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.vlan_state = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.iface_num = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.mtu = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.port = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.bootproto = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.subnet_mask = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.gateway = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.dhcp_alt_client_id = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.dhcp_dns = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.dhcp_learn_iqn = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.dhcp_vendor_id_state = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.dhcp_vendor_id = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.dhcp_slp_da = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.fragmentation = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.gratuitous_arp = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.incoming_forwarding = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.tos_state = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.tos = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.ttl = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.delayed_ack = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.tcp_nagle = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.tcp_wsf_state = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.tcp_wsf = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.tcp_timer_scale = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.tcp_timestamp = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.redirect = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.def_task_mgmt_timeout = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.header_digest = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.data_digest = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.immediate_data = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.initial_r2t = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.data_seq_inorder = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.data_pdu_inorder = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.erl = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.max_receive_data_len = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.first_burst_len = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.max_outstanding_r2t = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.max_burst_len = 0
Aug 16 12:23:33 user nova-compute[73520]: iface.chap_auth = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.bidi_chap = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.strict_login_compliance = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.discovery_auth = <empty>
Aug 16 12:23:33 user nova-compute[73520]: iface.discovery_logout = <empty>
Aug 16 12:23:33 user nova-compute[73520]: node.discovery_address = <empty>
Aug 16 12:23:33 user nova-compute[73520]: node.discovery_port = 0
Aug 16 12:23:33 user nova-compute[73520]: node.discovery_type = static
Aug 16 12:23:33 user nova-compute[73520]: node.session.initial_cmdsn = 0
Aug 16 12:23:33 user nova-compute[73520]: node.session.initial_login_retry_max = 8
Aug 16 12:23:33 user nova-compute[73520]: node.session.xmit_thread_priority = -20
Aug 16 12:23:33 user nova-compute[73520]: node.session.cmds_max = 128
Aug 16 12:23:33 user nova-compute[73520]: node.session.queue_depth = 32
Aug 16 12:23:33 user nova-compute[73520]: node.session.nr_sessions = 1
Aug 16 12:23:33 user nova-compute[73520]: node.session.auth.authmethod = CHAP
Aug 16 12:23:33 user nova-compute[73520]: node.session.auth.username = iKbLeqTJ
Aug 16 12:23:33 user nova-compute[73520]: node.session.auth.password = ***
Aug 16 12:23:33 user nova-compute[73520]: node.session.auth.username_in = <empty>
Aug 16 12:23:33 user nova-compute[73520]: node.session.auth.password_in = <empty>
Aug 16 12:23:33 user nova-compute[73520]: node.session.auth.chap_algs = MD5
Aug 16 12:23:33 user nova-compute[73520]: node.session.timeo.replacement_timeout = 120
Aug 16 12:23:33 user nova-compute[73520]: node.session.err_timeo.abort_timeout = 15
Aug 16 12:23:33 user nova-compute[73520]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 12:23:33 user nova-compute[73520]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 12:23:33 user nova-compute[73520]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 12:23:33 user nova-compute[73520]: node.session.iscsi.FastAbort = Yes
Aug 16 12:23:33 user nova-compute[73520]: node.session.iscsi.InitialR2T = No
Aug 16 12:23:33 user nova-compute[73520]: node.session.iscsi.ImmediateData = Yes
Aug 16 12:23:33 user nova-compute[73520]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 12:23:33 user nova-compute[73520]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 12:23:33 user nova-compute[73520]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 12:23:33 user nova-compute[73520]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 12:23:33 user nova-compute[73520]: node.session.iscsi.MaxConnections = 1
Aug 16 12:23:33 user nova-compute[73520]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 12:23:33 user nova-compute[73520]: node.session.iscsi.ERL = 0
Aug 16 12:23:33 user nova-compute[73520]: node.session.scan = manual
Aug 16 12:23:33 user nova-compute[73520]: node.session.reopen_max = 0
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].address = 172.16.0.220
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].port = 3260
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].startup = manual
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].tcp.window_size = 524288
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].tcp.type_of_service = 0
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].timeo.logout_timeout = 15
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].timeo.login_timeout = 15
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].timeo.auth_timeout = 45
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].iscsi.DataDigest = None
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].iscsi.IFMarker = No
Aug 16 12:23:33 user nova-compute[73520]: node.conn[0].iscsi.OFMarker = No
Aug 16 12:23:33 user nova-compute[73520]: # END RECORD
Aug 16 12:23:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6418b0-7b6b-43ad-adfe-9ac5ba3a0172]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0f17c9-ca41-4864-8ea7-187969b34959]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKbLeqTJ {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKbLeqTJ" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e13dc94-9718-473e-b07f-8153984c3345]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iKbLeqTJ'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[937c1cdc-23bd-4fda-b45c-37d1cbd5347b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc44362a-5e8e-4ff2-a95e-75cf76f0ebfd]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:23:33 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:23:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:23:33 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:23:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] HCTL ('34', '0', '0', 0) found on session 28 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[228d77da-db65-456d-a489-338bab92f6fd]: (4, ('0 0 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching for a device in session 28 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKbLeqTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.171s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] <== connect_volume: return (172ms) {'type': 'block', 'scsi_wwn': '23961336537333764', 'path': '/dev/sdc'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961336537333764', 'path': '/dev/sdc'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1670743928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1670743928',id=27,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:22:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-tusldpqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:22:06Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=ba7e17f9-c32c-425d-a1ae-3e2cf9c44752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "vif_mac": "fa:16:3e:79:4b:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "vif_mac": "fa:16:3e:79:4b:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:4b:42,bridge_name='br-int',has_traffic_filtering=True,id=c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bbbe2f-5b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.objects.instance [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'pci_devices' on Instance uuid ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:23:33 user nova-compute[73520]:   <uuid>ba7e17f9-c32c-425d-a1ae-3e2cf9c44752</uuid>
Aug 16 12:23:33 user nova-compute[73520]:   <name>instance-0000001b</name>
Aug 16 12:23:33 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:23:33 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:23:33 user nova-compute[73520]:   <metadata>
Aug 16 12:23:33 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:23:33 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:23:33 user nova-compute[73520]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1670743928</nova:name>
Aug 16 12:23:33 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:23:33</nova:creationTime>
Aug 16 12:23:33 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:23:33 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:23:33 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:23:33 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:23:33 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:23:33 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:23:33 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:23:33 user nova-compute[73520]:       <nova:owner>
Aug 16 12:23:33 user nova-compute[73520]:         <nova:user uuid="3d1e9417253f43b482e8ee5b3109a697">tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member</nova:user>
Aug 16 12:23:33 user nova-compute[73520]:         <nova:project uuid="4d3756b80f2243dca0b31ffea7438b5d">tempest-ServerBootFromVolumeStableRescueTest-1104312883</nova:project>
Aug 16 12:23:33 user nova-compute[73520]:       </nova:owner>
Aug 16 12:23:33 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:23:33 user nova-compute[73520]:       <nova:ports>
Aug 16 12:23:33 user nova-compute[73520]:         <nova:port uuid="c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b">
Aug 16 12:23:33 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 12:23:33 user nova-compute[73520]:         </nova:port>
Aug 16 12:23:33 user nova-compute[73520]:       </nova:ports>
Aug 16 12:23:33 user nova-compute[73520]:     </nova:instance>
Aug 16 12:23:33 user nova-compute[73520]:   </metadata>
Aug 16 12:23:33 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:23:33 user nova-compute[73520]:     <system>
Aug 16 12:23:33 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:23:33 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:23:33 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:23:33 user nova-compute[73520]:       <entry name="serial">ba7e17f9-c32c-425d-a1ae-3e2cf9c44752</entry>
Aug 16 12:23:33 user nova-compute[73520]:       <entry name="uuid">ba7e17f9-c32c-425d-a1ae-3e2cf9c44752</entry>
Aug 16 12:23:33 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:23:33 user nova-compute[73520]:     </system>
Aug 16 12:23:33 user nova-compute[73520]:   </sysinfo>
Aug 16 12:23:33 user nova-compute[73520]:   <os>
Aug 16 12:23:33 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:23:33 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:23:33 user nova-compute[73520]:   </os>
Aug 16 12:23:33 user nova-compute[73520]:   <features>
Aug 16 12:23:33 user nova-compute[73520]:     <acpi/>
Aug 16 12:23:33 user nova-compute[73520]:     <apic/>
Aug 16 12:23:33 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:23:33 user nova-compute[73520]:   </features>
Aug 16 12:23:33 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:23:33 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:23:33 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:23:33 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:23:33 user nova-compute[73520]:   </clock>
Aug 16 12:23:33 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:23:33 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:23:33 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:23:33 user nova-compute[73520]:   </cpu>
Aug 16 12:23:33 user nova-compute[73520]:   <devices>
Aug 16 12:23:33 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:23:33 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:23:33 user nova-compute[73520]:       <source dev="/dev/sdc"/>
Aug 16 12:23:33 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:23:33 user nova-compute[73520]:       <serial>d6d21150-539b-46cc-a671-ba0feeef3c7c</serial>
Aug 16 12:23:33 user nova-compute[73520]:     </disk>
Aug 16 12:23:33 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:23:33 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:23:33 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.rescue"/>
Aug 16 12:23:33 user nova-compute[73520]:       <target dev="vdb" bus="virtio"/>
Aug 16 12:23:33 user nova-compute[73520]:       <boot order="1"/>
Aug 16 12:23:33 user nova-compute[73520]:     </disk>
Aug 16 12:23:33 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:23:33 user nova-compute[73520]:       <mac address="fa:16:3e:79:4b:42"/>
Aug 16 12:23:33 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:23:33 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:23:33 user nova-compute[73520]:       <target dev="tapc0bbbe2f-5b"/>
Aug 16 12:23:33 user nova-compute[73520]:     </interface>
Aug 16 12:23:33 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:23:33 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/console.log" append="off"/>
Aug 16 12:23:33 user nova-compute[73520]:     </serial>
Aug 16 12:23:33 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:23:33 user nova-compute[73520]:     <video>
Aug 16 12:23:33 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:23:33 user nova-compute[73520]:     </video>
Aug 16 12:23:33 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:23:33 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:23:33 user nova-compute[73520]:     </rng>
Aug 16 12:23:33 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:23:33 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:23:33 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:23:33 user nova-compute[73520]:     </memballoon>
Aug 16 12:23:33 user nova-compute[73520]:   </devices>
Aug 16 12:23:33 user nova-compute[73520]: </domain>
Aug 16 12:23:33 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:23:33 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Instance destroyed successfully.
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No VIF found with MAC fa:16:3e:79:4b:42, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:23:33 user nova-compute[73520]: INFO nova.compute.claims [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Claim successful on node user
Aug 16 12:23:34 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:23:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:23:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG nova.policy [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6426c917725745038fdb1d03fec4a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1059841e2ee04ca4870497a1ec60bcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:23:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Creating image(s)
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "/opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "/opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.209s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.231s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk 1073741824" returned: 0 in 0.081s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] There are 0 instances to clean {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Successfully created port: fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-f1adf79d-e4ad-470d-ace0-6813a478321e req-6e513fb9-7204-46e4-b495-51d8d5e72505 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f1adf79d-e4ad-470d-ace0-6813a478321e req-6e513fb9-7204-46e4-b495-51d8d5e72505 service nova] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f1adf79d-e4ad-470d-ace0-6813a478321e req-6e513fb9-7204-46e4-b495-51d8d5e72505 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f1adf79d-e4ad-470d-ace0-6813a478321e req-6e513fb9-7204-46e4-b495-51d8d5e72505 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-f1adf79d-e4ad-470d-ace0-6813a478321e req-6e513fb9-7204-46e4-b495-51d8d5e72505 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] No waiting events found dispatching network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:35 user nova-compute[73520]: WARNING nova.compute.manager [req-f1adf79d-e4ad-470d-ace0-6813a478321e req-6e513fb9-7204-46e4-b495-51d8d5e72505 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received unexpected event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b for instance with vm_state active and task_state rescuing.
Aug 16 12:23:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Cannot resize image /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG nova.objects.instance [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'migration_context' on Instance uuid fa037e15-3751-4088-9607-e2bb2a8d4f01 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Ensure instance console log exists: /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:36 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Successfully updated port: fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:23:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "refresh_cache-fa037e15-3751-4088-9607-e2bb2a8d4f01" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:23:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquired lock "refresh_cache-fa037e15-3751-4088-9607-e2bb2a8d4f01" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:23:36 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:23:36 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:23:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-acd26caf-6095-41fc-a96f-f99e4e98537b req-ec900386-9cf8-42c5-8310-d3f7434c5073 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Received event network-changed-fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-acd26caf-6095-41fc-a96f-f99e4e98537b req-ec900386-9cf8-42c5-8310-d3f7434c5073 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Refreshing instance network info cache due to event network-changed-fd32a4f5-3408-4338-ac44-3253c58f650a. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:23:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-acd26caf-6095-41fc-a96f-f99e4e98537b req-ec900386-9cf8-42c5-8310-d3f7434c5073 service nova] Acquiring lock "refresh_cache-fa037e15-3751-4088-9607-e2bb2a8d4f01" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:23:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Updating instance_info_cache with network_info: [{"id": "fd32a4f5-3408-4338-ac44-3253c58f650a", "address": "fa:16:3e:e2:0e:27", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32a4f5-34", "ovs_interfaceid": "fd32a4f5-3408-4338-ac44-3253c58f650a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Releasing lock "refresh_cache-fa037e15-3751-4088-9607-e2bb2a8d4f01" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Instance network_info: |[{"id": "fd32a4f5-3408-4338-ac44-3253c58f650a", "address": "fa:16:3e:e2:0e:27", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32a4f5-34", "ovs_interfaceid": "fd32a4f5-3408-4338-ac44-3253c58f650a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-acd26caf-6095-41fc-a96f-f99e4e98537b req-ec900386-9cf8-42c5-8310-d3f7434c5073 service nova] Acquired lock "refresh_cache-fa037e15-3751-4088-9607-e2bb2a8d4f01" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.network.neutron [req-acd26caf-6095-41fc-a96f-f99e4e98537b req-ec900386-9cf8-42c5-8310-d3f7434c5073 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Refreshing network info cache for port fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Start _get_guest_xml network_info=[{"id": "fd32a4f5-3408-4338-ac44-3253c58f650a", "address": "fa:16:3e:e2:0e:27", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32a4f5-34", "ovs_interfaceid": "fd32a4f5-3408-4338-ac44-3253c58f650a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.compute.manager [req-b072c750-b203-425d-9f60-791749f36ef1 req-3e82b7e7-1305-4ad2-8cdc-3b8924343ab2 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b072c750-b203-425d-9f60-791749f36ef1 req-3e82b7e7-1305-4ad2-8cdc-3b8924343ab2 service nova] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b072c750-b203-425d-9f60-791749f36ef1 req-3e82b7e7-1305-4ad2-8cdc-3b8924343ab2 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b072c750-b203-425d-9f60-791749f36ef1 req-3e82b7e7-1305-4ad2-8cdc-3b8924343ab2 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.compute.manager [req-b072c750-b203-425d-9f60-791749f36ef1 req-3e82b7e7-1305-4ad2-8cdc-3b8924343ab2 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] No waiting events found dispatching network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:37 user nova-compute[73520]: WARNING nova.compute.manager [req-b072c750-b203-425d-9f60-791749f36ef1 req-3e82b7e7-1305-4ad2-8cdc-3b8924343ab2 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received unexpected event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b for instance with vm_state active and task_state rescuing.
Aug 16 12:23:37 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:23:37 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-636699223',display_name='tempest-AttachVolumeNegativeTest-server-636699223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-636699223',id=30,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRiLsytlAHoKZ5G9/35XcNKwvzBN5jWSHX3ECXJRwb8AIT7XiRliYsxSaxvY/llkP8MElmGAWbI4fMFGmzNrMNGlXOLRVcFPQoiU8/zdD4a/EM3tJHHQX9bhT65nJ7I2Q==',key_name='tempest-keypair-1606534571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1059841e2ee04ca4870497a1ec60bcaa',ramdisk_id='',reservation_id='r-w3vkfhm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1618912538',owner_user_name='tempest-AttachVolumeNegativeTest-1618912538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:23:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6426c917725745038fdb1d03fec4a2fd',uuid=fa037e15-3751-4088-9607-e2bb2a8d4f01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd32a4f5-3408-4338-ac44-3253c58f650a", "address": "fa:16:3e:e2:0e:27", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32a4f5-34", "ovs_interfaceid": "fd32a4f5-3408-4338-ac44-3253c58f650a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converting VIF {"id": "fd32a4f5-3408-4338-ac44-3253c58f650a", "address": "fa:16:3e:e2:0e:27", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32a4f5-34", "ovs_interfaceid": "fd32a4f5-3408-4338-ac44-3253c58f650a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=fd32a4f5-3408-4338-ac44-3253c58f650a,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32a4f5-34') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'pci_devices' on Instance uuid fa037e15-3751-4088-9607-e2bb2a8d4f01 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:23:37 user nova-compute[73520]:   <uuid>fa037e15-3751-4088-9607-e2bb2a8d4f01</uuid>
Aug 16 12:23:37 user nova-compute[73520]:   <name>instance-0000001e</name>
Aug 16 12:23:37 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:23:37 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:23:37 user nova-compute[73520]:   <metadata>
Aug 16 12:23:37 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:23:37 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:23:37 user nova-compute[73520]:       <nova:name>tempest-AttachVolumeNegativeTest-server-636699223</nova:name>
Aug 16 12:23:37 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:23:37</nova:creationTime>
Aug 16 12:23:37 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:23:37 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:23:37 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:23:37 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:23:37 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:23:37 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:23:37 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:23:37 user nova-compute[73520]:       <nova:owner>
Aug 16 12:23:37 user nova-compute[73520]:         <nova:user uuid="6426c917725745038fdb1d03fec4a2fd">tempest-AttachVolumeNegativeTest-1618912538-project-member</nova:user>
Aug 16 12:23:37 user nova-compute[73520]:         <nova:project uuid="1059841e2ee04ca4870497a1ec60bcaa">tempest-AttachVolumeNegativeTest-1618912538</nova:project>
Aug 16 12:23:37 user nova-compute[73520]:       </nova:owner>
Aug 16 12:23:37 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:23:37 user nova-compute[73520]:       <nova:ports>
Aug 16 12:23:37 user nova-compute[73520]:         <nova:port uuid="fd32a4f5-3408-4338-ac44-3253c58f650a">
Aug 16 12:23:37 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 12:23:37 user nova-compute[73520]:         </nova:port>
Aug 16 12:23:37 user nova-compute[73520]:       </nova:ports>
Aug 16 12:23:37 user nova-compute[73520]:     </nova:instance>
Aug 16 12:23:37 user nova-compute[73520]:   </metadata>
Aug 16 12:23:37 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:23:37 user nova-compute[73520]:     <system>
Aug 16 12:23:37 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:23:37 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:23:37 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:23:37 user nova-compute[73520]:       <entry name="serial">fa037e15-3751-4088-9607-e2bb2a8d4f01</entry>
Aug 16 12:23:37 user nova-compute[73520]:       <entry name="uuid">fa037e15-3751-4088-9607-e2bb2a8d4f01</entry>
Aug 16 12:23:37 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:23:37 user nova-compute[73520]:     </system>
Aug 16 12:23:37 user nova-compute[73520]:   </sysinfo>
Aug 16 12:23:37 user nova-compute[73520]:   <os>
Aug 16 12:23:37 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:23:37 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:23:37 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:23:37 user nova-compute[73520]:   </os>
Aug 16 12:23:37 user nova-compute[73520]:   <features>
Aug 16 12:23:37 user nova-compute[73520]:     <acpi/>
Aug 16 12:23:37 user nova-compute[73520]:     <apic/>
Aug 16 12:23:37 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:23:37 user nova-compute[73520]:   </features>
Aug 16 12:23:37 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:23:37 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:23:37 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:23:37 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:23:37 user nova-compute[73520]:   </clock>
Aug 16 12:23:37 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:23:37 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:23:37 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:23:37 user nova-compute[73520]:   </cpu>
Aug 16 12:23:37 user nova-compute[73520]:   <devices>
Aug 16 12:23:37 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:23:37 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:23:37 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk"/>
Aug 16 12:23:37 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:23:37 user nova-compute[73520]:     </disk>
Aug 16 12:23:37 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:23:37 user nova-compute[73520]:       <mac address="fa:16:3e:e2:0e:27"/>
Aug 16 12:23:37 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:23:37 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:23:37 user nova-compute[73520]:       <target dev="tapfd32a4f5-34"/>
Aug 16 12:23:37 user nova-compute[73520]:     </interface>
Aug 16 12:23:37 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:23:37 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/console.log" append="off"/>
Aug 16 12:23:37 user nova-compute[73520]:     </serial>
Aug 16 12:23:37 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:23:37 user nova-compute[73520]:     <video>
Aug 16 12:23:37 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:23:37 user nova-compute[73520]:     </video>
Aug 16 12:23:37 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:23:37 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:23:37 user nova-compute[73520]:     </rng>
Aug 16 12:23:37 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:23:37 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:23:37 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:23:37 user nova-compute[73520]:     </memballoon>
Aug 16 12:23:37 user nova-compute[73520]:   </devices>
Aug 16 12:23:37 user nova-compute[73520]: </domain>
Aug 16 12:23:37 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-636699223',display_name='tempest-AttachVolumeNegativeTest-server-636699223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-636699223',id=30,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRiLsytlAHoKZ5G9/35XcNKwvzBN5jWSHX3ECXJRwb8AIT7XiRliYsxSaxvY/llkP8MElmGAWbI4fMFGmzNrMNGlXOLRVcFPQoiU8/zdD4a/EM3tJHHQX9bhT65nJ7I2Q==',key_name='tempest-keypair-1606534571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1059841e2ee04ca4870497a1ec60bcaa',ramdisk_id='',reservation_id='r-w3vkfhm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1618912538',owner_user_name='tempest-AttachVolumeNegativeTest-1618912538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:23:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6426c917725745038fdb1d03fec4a2fd',uuid=fa037e15-3751-4088-9607-e2bb2a8d4f01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd32a4f5-3408-4338-ac44-3253c58f650a", "address": "fa:16:3e:e2:0e:27", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32a4f5-34", "ovs_interfaceid": "fd32a4f5-3408-4338-ac44-3253c58f650a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converting VIF {"id": "fd32a4f5-3408-4338-ac44-3253c58f650a", "address": "fa:16:3e:e2:0e:27", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32a4f5-34", "ovs_interfaceid": "fd32a4f5-3408-4338-ac44-3253c58f650a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=fd32a4f5-3408-4338-ac44-3253c58f650a,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32a4f5-34') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG os_vif [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=fd32a4f5-3408-4338-ac44-3253c58f650a,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32a4f5-34') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd32a4f5-34, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd32a4f5-34, col_values=(('external_ids', {'iface-id': 'fd32a4f5-3408-4338-ac44-3253c58f650a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:0e:27', 'vm-uuid': 'fa037e15-3751-4088-9607-e2bb2a8d4f01'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:37 user nova-compute[73520]: INFO os_vif [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=fd32a4f5-3408-4338-ac44-3253c58f650a,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32a4f5-34')
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Removed pending event for ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 due to event {{(pid=73520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188617.346229, ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:23:37 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] VM Resumed (Lifecycle Event)
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-17546ed7-8203-4902-b0a8-b3a9f4c38c5f tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No VIF found with MAC fa:16:3e:e2:0e:27, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:37 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188617.348175, ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:23:37 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] VM Started (Lifecycle Event)
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.network.neutron [req-acd26caf-6095-41fc-a96f-f99e4e98537b req-ec900386-9cf8-42c5-8310-d3f7434c5073 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Updated VIF entry in instance network info cache for port fd32a4f5-3408-4338-ac44-3253c58f650a. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.network.neutron [req-acd26caf-6095-41fc-a96f-f99e4e98537b req-ec900386-9cf8-42c5-8310-d3f7434c5073 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Updating instance_info_cache with network_info: [{"id": "fd32a4f5-3408-4338-ac44-3253c58f650a", "address": "fa:16:3e:e2:0e:27", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32a4f5-34", "ovs_interfaceid": "fd32a4f5-3408-4338-ac44-3253c58f650a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-acd26caf-6095-41fc-a96f-f99e4e98537b req-ec900386-9cf8-42c5-8310-d3f7434c5073 service nova] Releasing lock "refresh_cache-fa037e15-3751-4088-9607-e2bb2a8d4f01" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:23:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-2a70d311-efe6-4899-9430-8c760fa4a82b req-f1f7e317-f562-42c3-9ffd-ad4ee4d262c9 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Received event network-vif-plugged-fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2a70d311-efe6-4899-9430-8c760fa4a82b req-f1f7e317-f562-42c3-9ffd-ad4ee4d262c9 service nova] Acquiring lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2a70d311-efe6-4899-9430-8c760fa4a82b req-f1f7e317-f562-42c3-9ffd-ad4ee4d262c9 service nova] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2a70d311-efe6-4899-9430-8c760fa4a82b req-f1f7e317-f562-42c3-9ffd-ad4ee4d262c9 service nova] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-2a70d311-efe6-4899-9430-8c760fa4a82b req-f1f7e317-f562-42c3-9ffd-ad4ee4d262c9 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] No waiting events found dispatching network-vif-plugged-fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:39 user nova-compute[73520]: WARNING nova.compute.manager [req-2a70d311-efe6-4899-9430-8c760fa4a82b req-f1f7e317-f562-42c3-9ffd-ad4ee4d262c9 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Received unexpected event network-vif-plugged-fd32a4f5-3408-4338-ac44-3253c58f650a for instance with vm_state building and task_state spawning.
Aug 16 12:23:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:23:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188621.0828102, fa037e15-3751-4088-9607-e2bb2a8d4f01 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:23:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] VM Resumed (Lifecycle Event)
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:23:41 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Instance spawned successfully.
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:23:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188621.0838406, fa037e15-3751-4088-9607-e2bb2a8d4f01 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:23:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] VM Started (Lifecycle Event)
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-51dda2ce-94f6-4534-a006-c06e9bf81f04 req-45d2d91c-7fb2-41ba-aa4b-8c29562d3da0 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Received event network-vif-plugged-fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-51dda2ce-94f6-4534-a006-c06e9bf81f04 req-45d2d91c-7fb2-41ba-aa4b-8c29562d3da0 service nova] Acquiring lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-51dda2ce-94f6-4534-a006-c06e9bf81f04 req-45d2d91c-7fb2-41ba-aa4b-8c29562d3da0 service nova] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-51dda2ce-94f6-4534-a006-c06e9bf81f04 req-45d2d91c-7fb2-41ba-aa4b-8c29562d3da0 service nova] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-51dda2ce-94f6-4534-a006-c06e9bf81f04 req-45d2d91c-7fb2-41ba-aa4b-8c29562d3da0 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] No waiting events found dispatching network-vif-plugged-fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:41 user nova-compute[73520]: WARNING nova.compute.manager [req-51dda2ce-94f6-4534-a006-c06e9bf81f04 req-45d2d91c-7fb2-41ba-aa4b-8c29562d3da0 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Received unexpected event network-vif-plugged-fd32a4f5-3408-4338-ac44-3253c58f650a for instance with vm_state building and task_state spawning.
Aug 16 12:23:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:23:41 user nova-compute[73520]: INFO nova.compute.manager [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Took 6.88 seconds to spawn the instance on the hypervisor.
Aug 16 12:23:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:23:41 user nova-compute[73520]: INFO nova.compute.manager [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Took 7.64 seconds to build instance.
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ff1a2f43-53cb-4247-84c0-c7ae42f162ba tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.739s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:42 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:23:42 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7281MB free_disk=25.316551208496094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 91e479f7-5fc0-46d2-9c02-52175084fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 9ab085c8-d666-4525-bee5-d61aada89a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance e3236316-dada-4aee-a210-6d9e9950c166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance b58731e0-399d-4f8d-84b8-af12a46cf87f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 3fcba05a-678c-403f-be48-bd22095facd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance e0c2b937-066a-490f-a2a2-57ae3dfe814b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance fa037e15-3751-4088-9607-e2bb2a8d4f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:23:42 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:23:43 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing inventories for resource provider 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 12:23:43 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating ProviderTree inventory for provider 70dde5f5-9594-47c3-954e-598dd3089747 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 12:23:43 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 12:23:43 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing aggregate associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, aggregates: None {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 12:23:43 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing trait associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 12:23:43 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:23:43 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:23:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:23:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:23:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:23:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:23:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:23:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:54 user nova-compute[73520]: INFO nova.compute.manager [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Terminating instance
Aug 16 12:23:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-73452a72-f7ae-42a1-aaba-27d70ddba9b1 req-94c110f2-fcd3-4f3e-a752-94f8954317e0 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-vif-unplugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-73452a72-f7ae-42a1-aaba-27d70ddba9b1 req-94c110f2-fcd3-4f3e-a752-94f8954317e0 service nova] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-73452a72-f7ae-42a1-aaba-27d70ddba9b1 req-94c110f2-fcd3-4f3e-a752-94f8954317e0 service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-73452a72-f7ae-42a1-aaba-27d70ddba9b1 req-94c110f2-fcd3-4f3e-a752-94f8954317e0 service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-73452a72-f7ae-42a1-aaba-27d70ddba9b1 req-94c110f2-fcd3-4f3e-a752-94f8954317e0 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] No waiting events found dispatching network-vif-unplugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-73452a72-f7ae-42a1-aaba-27d70ddba9b1 req-94c110f2-fcd3-4f3e-a752-94f8954317e0 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-vif-unplugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:54 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Instance destroyed successfully.
Aug 16 12:23:54 user nova-compute[73520]: DEBUG nova.objects.instance [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'resources' on Instance uuid b58731e0-399d-4f8d-84b8-af12a46cf87f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-466509847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-466509847',id=16,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/TnCMohAy4YwXrP4QswrIkP1s67kKydcbM5umHWevLWUF7aB+KeIUkVDD5UpM/sLWKALtErDoubQvYXCvUMMCn8aBxFpkp9OZ9pdoPDYMWBV95Mwsn9Y+0MGtOI3A22Q==',key_name='tempest-keypair-536458928',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:21:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed29e455a840474b8a1407af538883ab',ramdisk_id='',reservation_id='r-ivvsky98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-974908846',owner_user_name='tempest-AttachVolumeShelveTestJSON-974908846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:21:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7e48ee408e24af083b40b19437cfbac',uuid=b58731e0-399d-4f8d-84b8-af12a46cf87f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converting VIF {"id": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "address": "fa:16:3e:e6:e2:11", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc71dc-3e", "ovs_interfaceid": "f9fc71dc-3ee9-497a-a60e-e39046c2d9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG os_vif [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9fc71dc-3e, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:23:54 user nova-compute[73520]: INFO os_vif [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=f9fc71dc-3ee9-497a-a60e-e39046c2d9f3,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc71dc-3e')
Aug 16 12:23:54 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Deleting instance files /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f_del
Aug 16 12:23:54 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Deletion of /opt/stack/data/nova/instances/b58731e0-399d-4f8d-84b8-af12a46cf87f_del complete
Aug 16 12:23:54 user nova-compute[73520]: INFO nova.compute.manager [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 12:23:54 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:23:54 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:23:55 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:23:55 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Took 0.85 seconds to deallocate network for instance.
Aug 16 12:23:55 user nova-compute[73520]: DEBUG nova.compute.manager [req-ce4b8a38-e115-4714-802b-77c8b3d1b372 req-64db0bdf-4d9d-428a-9007-1c0df0031807 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-vif-deleted-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "3fcba05a-678c-403f-be48-bd22095facd4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "3fcba05a-678c-403f-be48-bd22095facd4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "3fcba05a-678c-403f-be48-bd22095facd4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "3fcba05a-678c-403f-be48-bd22095facd4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "3fcba05a-678c-403f-be48-bd22095facd4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:55 user nova-compute[73520]: INFO nova.compute.manager [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Terminating instance
Aug 16 12:23:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-df300318-4c7a-4b3a-a951-fb3f148e2c70 req-673dcca1-b09f-4706-8bdc-cfdb599f4a89 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Received event network-vif-unplugged-7e0d5e6e-9976-4b42-b655-10b9737e03fc {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df300318-4c7a-4b3a-a951-fb3f148e2c70 req-673dcca1-b09f-4706-8bdc-cfdb599f4a89 service nova] Acquiring lock "3fcba05a-678c-403f-be48-bd22095facd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df300318-4c7a-4b3a-a951-fb3f148e2c70 req-673dcca1-b09f-4706-8bdc-cfdb599f4a89 service nova] Lock "3fcba05a-678c-403f-be48-bd22095facd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df300318-4c7a-4b3a-a951-fb3f148e2c70 req-673dcca1-b09f-4706-8bdc-cfdb599f4a89 service nova] Lock "3fcba05a-678c-403f-be48-bd22095facd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-df300318-4c7a-4b3a-a951-fb3f148e2c70 req-673dcca1-b09f-4706-8bdc-cfdb599f4a89 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] No waiting events found dispatching network-vif-unplugged-7e0d5e6e-9976-4b42-b655-10b9737e03fc {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-df300318-4c7a-4b3a-a951-fb3f148e2c70 req-673dcca1-b09f-4706-8bdc-cfdb599f4a89 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Received event network-vif-unplugged-7e0d5e6e-9976-4b42-b655-10b9737e03fc for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:56 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Deleted allocations for instance b58731e0-399d-4f8d-84b8-af12a46cf87f
Aug 16 12:23:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-425369ae-ca6e-47e2-907d-c2df2d203f9a tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.328s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-95afb117-43d9-4afd-9787-b2815f517a45 req-04971f1b-89e9-4023-835a-317ea664c2d3 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received event network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-95afb117-43d9-4afd-9787-b2815f517a45 req-04971f1b-89e9-4023-835a-317ea664c2d3 service nova] Acquiring lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-95afb117-43d9-4afd-9787-b2815f517a45 req-04971f1b-89e9-4023-835a-317ea664c2d3 service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-95afb117-43d9-4afd-9787-b2815f517a45 req-04971f1b-89e9-4023-835a-317ea664c2d3 service nova] Lock "b58731e0-399d-4f8d-84b8-af12a46cf87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-95afb117-43d9-4afd-9787-b2815f517a45 req-04971f1b-89e9-4023-835a-317ea664c2d3 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] No waiting events found dispatching network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:56 user nova-compute[73520]: WARNING nova.compute.manager [req-95afb117-43d9-4afd-9787-b2815f517a45 req-04971f1b-89e9-4023-835a-317ea664c2d3 service nova] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Received unexpected event network-vif-plugged-f9fc71dc-3ee9-497a-a60e-e39046c2d9f3 for instance with vm_state deleted and task_state None.
Aug 16 12:23:56 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Instance destroyed successfully.
Aug 16 12:23:56 user nova-compute[73520]: DEBUG nova.objects.instance [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lazy-loading 'resources' on Instance uuid 3fcba05a-678c-403f-be48-bd22095facd4 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:22:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-637327725',display_name='tempest-VolumesActionsTest-instance-637327725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-637327725',id=28,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:22:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa2639b61de64add87f6510f520aa158',ramdisk_id='',reservation_id='r-leb0cic4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-623859009',owner_user_name='tempest-VolumesActionsTest-623859009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:22:13Z,user_data=None,user_id='223a4316eda946d38dd77143a4847484',uuid=3fcba05a-678c-403f-be48-bd22095facd4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "address": "fa:16:3e:51:fc:b6", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0d5e6e-99", "ovs_interfaceid": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Converting VIF {"id": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "address": "fa:16:3e:51:fc:b6", "network": {"id": "a0f0883c-b0b8-4a7c-b099-91bc2bba86ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1283054239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2639b61de64add87f6510f520aa158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0d5e6e-99", "ovs_interfaceid": "7e0d5e6e-9976-4b42-b655-10b9737e03fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:fc:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e0d5e6e-9976-4b42-b655-10b9737e03fc,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0d5e6e-99') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG os_vif [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:fc:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e0d5e6e-9976-4b42-b655-10b9737e03fc,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0d5e6e-99') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e0d5e6e-99, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:56 user nova-compute[73520]: INFO os_vif [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:fc:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e0d5e6e-9976-4b42-b655-10b9737e03fc,network=Network(a0f0883c-b0b8-4a7c-b099-91bc2bba86ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0d5e6e-99')
Aug 16 12:23:56 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Deleting instance files /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4_del
Aug 16 12:23:56 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Deletion of /opt/stack/data/nova/instances/3fcba05a-678c-403f-be48-bd22095facd4_del complete
Aug 16 12:23:56 user nova-compute[73520]: INFO nova.compute.manager [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 16 12:23:56 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:23:56 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "e3236316-dada-4aee-a210-6d9e9950c166" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:57 user nova-compute[73520]: INFO nova.compute.manager [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Terminating instance
Aug 16 12:23:57 user nova-compute[73520]: DEBUG nova.compute.manager [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:23:57 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Took 0.54 seconds to deallocate network for instance.
Aug 16 12:23:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-ce009154-7a8d-4a56-a00d-548acc14ff9b req-23513d9f-a717-451b-8d5a-66c6e0b8283e service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Received event network-vif-deleted-7e0d5e6e-9976-4b42-b655-10b9737e03fc {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-ce009154-7a8d-4a56-a00d-548acc14ff9b req-23513d9f-a717-451b-8d5a-66c6e0b8283e service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-unplugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ce009154-7a8d-4a56-a00d-548acc14ff9b req-23513d9f-a717-451b-8d5a-66c6e0b8283e service nova] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ce009154-7a8d-4a56-a00d-548acc14ff9b req-23513d9f-a717-451b-8d5a-66c6e0b8283e service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ce009154-7a8d-4a56-a00d-548acc14ff9b req-23513d9f-a717-451b-8d5a-66c6e0b8283e service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-ce009154-7a8d-4a56-a00d-548acc14ff9b req-23513d9f-a717-451b-8d5a-66c6e0b8283e service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] No waiting events found dispatching network-vif-unplugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-ce009154-7a8d-4a56-a00d-548acc14ff9b req-23513d9f-a717-451b-8d5a-66c6e0b8283e service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-unplugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:23:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:57 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Deleted allocations for instance 3fcba05a-678c-403f-be48-bd22095facd4
Aug 16 12:23:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-592de2ef-1d07-496b-93dd-24f2d72534bb tempest-VolumesActionsTest-623859009 tempest-VolumesActionsTest-623859009-project-member] Lock "3fcba05a-678c-403f-be48-bd22095facd4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.067s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:58 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Instance destroyed successfully.
Aug 16 12:23:58 user nova-compute[73520]: DEBUG nova.objects.instance [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lazy-loading 'resources' on Instance uuid e3236316-dada-4aee-a210-6d9e9950c166 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T12:20:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237150177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237150177',id=23,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLqlkeW8K4/NYjRCJM4DThn3bJr4LmJGxj2R3Ahh8DNjzuZ9KWKu2ENvKunjOIly8U/grW0cxfrq3RvxlK8fCQ+TzP/dQAKgugcoqQDuK4pTxhnxyfh+UcCyNr/VbXPmw==',key_name='tempest-keypair-1386297183',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='334e1cae88394856b698916811059782',ramdisk_id='',reservation_id='r-kqjagab3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1067579941',owner_user_name='tempest-TaggedAttachmentsTest-1067579941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1830f07ec8441a98454a18fd3a2e5a9',uuid=e3236316-dada-4aee-a210-6d9e9950c166,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converting VIF {"id": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "address": "fa:16:3e:a1:f5:32", "network": {"id": "f69a4506-0d64-45bb-999c-cc0ac88b9830", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2036608701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "334e1cae88394856b698916811059782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af832cf-a4", "ovs_interfaceid": "7af832cf-a4a6-4c84-8ca3-0b578347bbc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=7af832cf-a4a6-4c84-8ca3-0b578347bbc0,network=Network(f69a4506-0d64-45bb-999c-cc0ac88b9830),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af832cf-a4') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG os_vif [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=7af832cf-a4a6-4c84-8ca3-0b578347bbc0,network=Network(f69a4506-0d64-45bb-999c-cc0ac88b9830),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af832cf-a4') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7af832cf-a4, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:58 user nova-compute[73520]: INFO os_vif [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:f5:32,bridge_name='br-int',has_traffic_filtering=True,id=7af832cf-a4a6-4c84-8ca3-0b578347bbc0,network=Network(f69a4506-0d64-45bb-999c-cc0ac88b9830),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af832cf-a4')
Aug 16 12:23:58 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Deleting instance files /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166_del
Aug 16 12:23:58 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Deletion of /opt/stack/data/nova/instances/e3236316-dada-4aee-a210-6d9e9950c166_del complete
Aug 16 12:23:58 user nova-compute[73520]: INFO nova.compute.manager [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 12:23:58 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: e3236316-dada-4aee-a210-6d9e9950c166] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-63da39e5-0727-4bf8-8102-af890b930524 req-9fb9e644-95ce-4b91-9b8e-ba65300f5714 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Received event network-vif-plugged-7e0d5e6e-9976-4b42-b655-10b9737e03fc {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-63da39e5-0727-4bf8-8102-af890b930524 req-9fb9e644-95ce-4b91-9b8e-ba65300f5714 service nova] Acquiring lock "3fcba05a-678c-403f-be48-bd22095facd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-63da39e5-0727-4bf8-8102-af890b930524 req-9fb9e644-95ce-4b91-9b8e-ba65300f5714 service nova] Lock "3fcba05a-678c-403f-be48-bd22095facd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-63da39e5-0727-4bf8-8102-af890b930524 req-9fb9e644-95ce-4b91-9b8e-ba65300f5714 service nova] Lock "3fcba05a-678c-403f-be48-bd22095facd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-63da39e5-0727-4bf8-8102-af890b930524 req-9fb9e644-95ce-4b91-9b8e-ba65300f5714 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] No waiting events found dispatching network-vif-plugged-7e0d5e6e-9976-4b42-b655-10b9737e03fc {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:58 user nova-compute[73520]: WARNING nova.compute.manager [req-63da39e5-0727-4bf8-8102-af890b930524 req-9fb9e644-95ce-4b91-9b8e-ba65300f5714 service nova] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Received unexpected event network-vif-plugged-7e0d5e6e-9976-4b42-b655-10b9737e03fc for instance with vm_state deleted and task_state None.
Aug 16 12:23:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:23:59 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Took 1.45 seconds to deallocate network for instance.
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] No waiting events found dispatching network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:59 user nova-compute[73520]: WARNING nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received unexpected event network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 for instance with vm_state deleted and task_state None.
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] No waiting events found dispatching network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:59 user nova-compute[73520]: WARNING nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received unexpected event network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 for instance with vm_state deleted and task_state None.
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] No waiting events found dispatching network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:59 user nova-compute[73520]: WARNING nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received unexpected event network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 for instance with vm_state deleted and task_state None.
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-unplugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] No waiting events found dispatching network-vif-unplugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:59 user nova-compute[73520]: WARNING nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received unexpected event network-vif-unplugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 for instance with vm_state deleted and task_state None.
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Acquiring lock "e3236316-dada-4aee-a210-6d9e9950c166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] Lock "e3236316-dada-4aee-a210-6d9e9950c166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] No waiting events found dispatching network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:23:59 user nova-compute[73520]: WARNING nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received unexpected event network-vif-plugged-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 for instance with vm_state deleted and task_state None.
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-056ac3d9-74cf-4dac-bc94-bcbca3c22817 req-0fb2146d-2c46-4d65-bec3-ecd1e0e548b0 service nova] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Received event network-vif-deleted-7af832cf-a4a6-4c84-8ca3-0b578347bbc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:23:59 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:24:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:00 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Deleted allocations for instance e3236316-dada-4aee-a210-6d9e9950c166
Aug 16 12:24:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-392c2965-9014-4030-a07f-64170e6edffc tempest-TaggedAttachmentsTest-1067579941 tempest-TaggedAttachmentsTest-1067579941-project-member] Lock "e3236316-dada-4aee-a210-6d9e9950c166" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.811s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:06 user nova-compute[73520]: DEBUG nova.compute.manager [req-15bd9d83-1386-468d-8822-c8f8fe004c88 req-6702b014-7f80-442e-9085-059499bd75dd service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Received event network-changed-27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:24:06 user nova-compute[73520]: DEBUG nova.compute.manager [req-15bd9d83-1386-468d-8822-c8f8fe004c88 req-6702b014-7f80-442e-9085-059499bd75dd service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Refreshing instance network info cache due to event network-changed-27d75b6f-6479-4d50-9c9e-f0dc8800b660. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:24:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-15bd9d83-1386-468d-8822-c8f8fe004c88 req-6702b014-7f80-442e-9085-059499bd75dd service nova] Acquiring lock "refresh_cache-e0c2b937-066a-490f-a2a2-57ae3dfe814b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:24:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-15bd9d83-1386-468d-8822-c8f8fe004c88 req-6702b014-7f80-442e-9085-059499bd75dd service nova] Acquired lock "refresh_cache-e0c2b937-066a-490f-a2a2-57ae3dfe814b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:24:06 user nova-compute[73520]: DEBUG nova.network.neutron [req-15bd9d83-1386-468d-8822-c8f8fe004c88 req-6702b014-7f80-442e-9085-059499bd75dd service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Refreshing network info cache for port 27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:24:06 user nova-compute[73520]: DEBUG nova.network.neutron [req-15bd9d83-1386-468d-8822-c8f8fe004c88 req-6702b014-7f80-442e-9085-059499bd75dd service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Updated VIF entry in instance network info cache for port 27d75b6f-6479-4d50-9c9e-f0dc8800b660. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:24:06 user nova-compute[73520]: DEBUG nova.network.neutron [req-15bd9d83-1386-468d-8822-c8f8fe004c88 req-6702b014-7f80-442e-9085-059499bd75dd service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Updating instance_info_cache with network_info: [{"id": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "address": "fa:16:3e:b6:90:a6", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d75b6f-64", "ovs_interfaceid": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:24:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-15bd9d83-1386-468d-8822-c8f8fe004c88 req-6702b014-7f80-442e-9085-059499bd75dd service nova] Releasing lock "refresh_cache-e0c2b937-066a-490f-a2a2-57ae3dfe814b" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:24:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:09 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188634.8219905, b58731e0-399d-4f8d-84b8-af12a46cf87f => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:24:09 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] VM Stopped (Lifecycle Event)
Aug 16 12:24:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-85b5397a-22b3-4c3c-b81f-c9bd132607b7 None None] [instance: b58731e0-399d-4f8d-84b8-af12a46cf87f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:24:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "9ab085c8-d666-4525-bee5-d61aada89a7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:10 user nova-compute[73520]: INFO nova.compute.manager [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Terminating instance
Aug 16 12:24:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:24:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-8f92e51d-85ba-4b33-b006-aa7a2f05adbf req-b556c639-27b1-422f-9b4d-965058df6a6f service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Received event network-vif-unplugged-4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8f92e51d-85ba-4b33-b006-aa7a2f05adbf req-b556c639-27b1-422f-9b4d-965058df6a6f service nova] Acquiring lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8f92e51d-85ba-4b33-b006-aa7a2f05adbf req-b556c639-27b1-422f-9b4d-965058df6a6f service nova] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8f92e51d-85ba-4b33-b006-aa7a2f05adbf req-b556c639-27b1-422f-9b4d-965058df6a6f service nova] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-8f92e51d-85ba-4b33-b006-aa7a2f05adbf req-b556c639-27b1-422f-9b4d-965058df6a6f service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] No waiting events found dispatching network-vif-unplugged-4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-8f92e51d-85ba-4b33-b006-aa7a2f05adbf req-b556c639-27b1-422f-9b4d-965058df6a6f service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Received event network-vif-unplugged-4236a073-45ce-42b4-bedd-e568a6ed5ebd for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188636.5631928, 3fcba05a-678c-403f-be48-bd22095facd4 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:24:11 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] VM Stopped (Lifecycle Event)
Aug 16 12:24:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4d811175-b2e4-4820-a95f-20632ffcc36d None None] [instance: 3fcba05a-678c-403f-be48-bd22095facd4] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:24:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Instance destroyed successfully.
Aug 16 12:24:11 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lazy-loading 'resources' on Instance uuid 9ab085c8-d666-4525-bee5-d61aada89a7a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1534208989',display_name='tempest-TestServerVolumeAttachmentScenario-server-1534208989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1534208989',id=22,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ8j+1y5HzBckSPMamPkoZpNfGqZgxOmSOCq0vhABwKNGb3UqkDpYL8QCjwrHp54ew+zQzBDxkNE2+40hFUNkW8lIwcxecq2SPJ7A1jdvom8S9C/KlPdX15ij386MWq/w==',key_name='tempest-keypair-1854452323',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:19:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5436806c15a841fa8b3caec7bc2c60a4',ramdisk_id='',reservation_id='r-augwjv69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1869633662',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1869633662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:19:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='deb886afd1c74c7faf40093c363f2003',uuid=9ab085c8-d666-4525-bee5-d61aada89a7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "address": "fa:16:3e:ac:d9:71", "network": {"id": "e1920a82-145c-47c4-ba96-97c266bb7208", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-763027158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5436806c15a841fa8b3caec7bc2c60a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4236a073-45", "ovs_interfaceid": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Converting VIF {"id": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "address": "fa:16:3e:ac:d9:71", "network": {"id": "e1920a82-145c-47c4-ba96-97c266bb7208", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-763027158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5436806c15a841fa8b3caec7bc2c60a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4236a073-45", "ovs_interfaceid": "4236a073-45ce-42b4-bedd-e568a6ed5ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:d9:71,bridge_name='br-int',has_traffic_filtering=True,id=4236a073-45ce-42b4-bedd-e568a6ed5ebd,network=Network(e1920a82-145c-47c4-ba96-97c266bb7208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4236a073-45') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG os_vif [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:d9:71,bridge_name='br-int',has_traffic_filtering=True,id=4236a073-45ce-42b4-bedd-e568a6ed5ebd,network=Network(e1920a82-145c-47c4-ba96-97c266bb7208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4236a073-45') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4236a073-45, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:11 user nova-compute[73520]: INFO os_vif [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:d9:71,bridge_name='br-int',has_traffic_filtering=True,id=4236a073-45ce-42b4-bedd-e568a6ed5ebd,network=Network(e1920a82-145c-47c4-ba96-97c266bb7208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4236a073-45')
Aug 16 12:24:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Deleting instance files /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a_del
Aug 16 12:24:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Deletion of /opt/stack/data/nova/instances/9ab085c8-d666-4525-bee5-d61aada89a7a_del complete
Aug 16 12:24:11 user nova-compute[73520]: INFO nova.compute.manager [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 16 12:24:11 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:24:11 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:24:12 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:24:12 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Took 0.91 seconds to deallocate network for instance.
Aug 16 12:24:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:13 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:24:13 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:24:13 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188638.1101515, e3236316-dada-4aee-a210-6d9e9950c166 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:24:13 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: e3236316-dada-4aee-a210-6d9e9950c166] VM Stopped (Lifecycle Event)
Aug 16 12:24:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6eba9aa6-aae7-4272-9c2f-ced525238d08 None None] [instance: e3236316-dada-4aee-a210-6d9e9950c166] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:24:13 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Deleted allocations for instance 9ab085c8-d666-4525-bee5-d61aada89a7a
Aug 16 12:24:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8887c70-dcbe-4a3e-a91a-52d34eaf9baf tempest-TestServerVolumeAttachmentScenario-1869633662 tempest-TestServerVolumeAttachmentScenario-1869633662-project-member] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.432s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-321592c2-6220-4673-a3dd-d5b67ce32194 req-6c593b12-9671-4c61-b775-5bb280825f6f service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Received event network-vif-plugged-4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:24:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-321592c2-6220-4673-a3dd-d5b67ce32194 req-6c593b12-9671-4c61-b775-5bb280825f6f service nova] Acquiring lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-321592c2-6220-4673-a3dd-d5b67ce32194 req-6c593b12-9671-4c61-b775-5bb280825f6f service nova] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-321592c2-6220-4673-a3dd-d5b67ce32194 req-6c593b12-9671-4c61-b775-5bb280825f6f service nova] Lock "9ab085c8-d666-4525-bee5-d61aada89a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-321592c2-6220-4673-a3dd-d5b67ce32194 req-6c593b12-9671-4c61-b775-5bb280825f6f service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] No waiting events found dispatching network-vif-plugged-4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:24:13 user nova-compute[73520]: WARNING nova.compute.manager [req-321592c2-6220-4673-a3dd-d5b67ce32194 req-6c593b12-9671-4c61-b775-5bb280825f6f service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Received unexpected event network-vif-plugged-4236a073-45ce-42b4-bedd-e568a6ed5ebd for instance with vm_state deleted and task_state None.
Aug 16 12:24:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-321592c2-6220-4673-a3dd-d5b67ce32194 req-6c593b12-9671-4c61-b775-5bb280825f6f service nova] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Received event network-vif-deleted-4236a073-45ce-42b4-bedd-e568a6ed5ebd {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:24:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "927fcd07-08e3-43ba-a6c2-730e0c557311" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:19 user nova-compute[73520]: DEBUG nova.compute.manager [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:24:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:19 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:24:19 user nova-compute[73520]: INFO nova.compute.claims [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Claim successful on node user
Aug 16 12:24:19 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:24:19 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:24:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:19 user nova-compute[73520]: DEBUG nova.compute.manager [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:24:20 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:24:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:24:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:24:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:24:20 user nova-compute[73520]: INFO nova.virt.block_device [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Booting with volume snapshot 0a6e2e6d-f15c-43cf-b215-a9847f17018f at /dev/vda
Aug 16 12:24:20 user nova-compute[73520]: DEBUG nova.policy [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17ed1823b0de433ab523470e235fdd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a693cd27934644be8e64731417c66783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:24:21 user nova-compute[73520]: DEBUG nova.network.neutron [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Successfully created port: f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:24:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.network.neutron [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Successfully updated port: f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "refresh_cache-927fcd07-08e3-43ba-a6c2-730e0c557311" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquired lock "refresh_cache-927fcd07-08e3-43ba-a6c2-730e0c557311" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.network.neutron [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-7b04b7e1-7a44-4e02-8a0b-2217d3e185ad req-b8bc0490-4d20-44ab-83e3-4e38ce641d3d service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received event network-changed-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-7b04b7e1-7a44-4e02-8a0b-2217d3e185ad req-b8bc0490-4d20-44ab-83e3-4e38ce641d3d service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Refreshing instance network info cache due to event network-changed-f3809be6-2f1f-4594-b632-829bfd841717. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7b04b7e1-7a44-4e02-8a0b-2217d3e185ad req-b8bc0490-4d20-44ab-83e3-4e38ce641d3d service nova] Acquiring lock "refresh_cache-927fcd07-08e3-43ba-a6c2-730e0c557311" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.network.neutron [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:24:22 user nova-compute[73520]: INFO nova.compute.claims [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Claim successful on node user
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.network.neutron [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Updating instance_info_cache with network_info: [{"id": "f3809be6-2f1f-4594-b632-829bfd841717", "address": "fa:16:3e:34:60:18", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3809be6-2f", "ovs_interfaceid": "f3809be6-2f1f-4594-b632-829bfd841717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Releasing lock "refresh_cache-927fcd07-08e3-43ba-a6c2-730e0c557311" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Instance network_info: |[{"id": "f3809be6-2f1f-4594-b632-829bfd841717", "address": "fa:16:3e:34:60:18", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3809be6-2f", "ovs_interfaceid": "f3809be6-2f1f-4594-b632-829bfd841717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7b04b7e1-7a44-4e02-8a0b-2217d3e185ad req-b8bc0490-4d20-44ab-83e3-4e38ce641d3d service nova] Acquired lock "refresh_cache-927fcd07-08e3-43ba-a6c2-730e0c557311" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.network.neutron [req-7b04b7e1-7a44-4e02-8a0b-2217d3e185ad req-b8bc0490-4d20-44ab-83e3-4e38ce641d3d service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Refreshing network info cache for port f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.network.neutron [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:24:22 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:24:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:24:23 user nova-compute[73520]: INFO nova.virt.block_device [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Booting with volume e370c4ce-2c3d-495a-a7c3-f138777b2f20 at /dev/vda
Aug 16 12:24:23 user nova-compute[73520]: DEBUG nova.policy [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2495e37a99546deb000789aac42ed34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dd566104a645fd8abda43da8d9b980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG os_brick.utils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5ad340-dcc5-4ac2-a640-5735523cc146]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG nova.network.neutron [req-7b04b7e1-7a44-4e02-8a0b-2217d3e185ad req-b8bc0490-4d20-44ab-83e3-4e38ce641d3d service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Updated VIF entry in instance network info cache for port f3809be6-2f1f-4594-b632-829bfd841717. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG nova.network.neutron [req-7b04b7e1-7a44-4e02-8a0b-2217d3e185ad req-b8bc0490-4d20-44ab-83e3-4e38ce641d3d service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Updating instance_info_cache with network_info: [{"id": "f3809be6-2f1f-4594-b632-829bfd841717", "address": "fa:16:3e:34:60:18", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3809be6-2f", "ovs_interfaceid": "f3809be6-2f1f-4594-b632-829bfd841717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[606d9b38-247f-41d5-925d-d6266ca5c49a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7b04b7e1-7a44-4e02-8a0b-2217d3e185ad req-b8bc0490-4d20-44ab-83e3-4e38ce641d3d service nova] Releasing lock "refresh_cache-927fcd07-08e3-43ba-a6c2-730e0c557311" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5192146-bf07-42c4-a1eb-811ed77b966b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[15943f5c-ba23-473b-960c-4625255d8eaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:24:23 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:24:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff1a026-16a6-4c64-86db-c1b6b30462ca]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG os_brick.utils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updating existing volume attachment record: 54a0e557-c06e-4666-aaea-6d714d4004ee {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG nova.network.neutron [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Successfully created port: 9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:24:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:24 user nova-compute[73520]: DEBUG nova.network.neutron [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Successfully updated port: 9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:24:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:24:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquired lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:24:24 user nova-compute[73520]: DEBUG nova.network.neutron [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:24:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-b6327497-b8f7-4c2f-a40f-a7fb85d094ba req-ce1cc2cf-5ffb-40a8-8ad2-3598425de9c4 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received event network-changed-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:24:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-b6327497-b8f7-4c2f-a40f-a7fb85d094ba req-ce1cc2cf-5ffb-40a8-8ad2-3598425de9c4 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Refreshing instance network info cache due to event network-changed-9a58f602-1dd8-46b4-8cc6-f5ef41b44750. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:24:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b6327497-b8f7-4c2f-a40f-a7fb85d094ba req-ce1cc2cf-5ffb-40a8-8ad2-3598425de9c4 service nova] Acquiring lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:24:24 user nova-compute[73520]: DEBUG nova.network.neutron [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:24:24 user nova-compute[73520]: DEBUG nova.network.neutron [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updating instance_info_cache with network_info: [{"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:24:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Releasing lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:24:24 user nova-compute[73520]: DEBUG nova.compute.manager [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Instance network_info: |[{"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:24:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b6327497-b8f7-4c2f-a40f-a7fb85d094ba req-ce1cc2cf-5ffb-40a8-8ad2-3598425de9c4 service nova] Acquired lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:24:24 user nova-compute[73520]: DEBUG nova.network.neutron [req-b6327497-b8f7-4c2f-a40f-a7fb85d094ba req-ce1cc2cf-5ffb-40a8-8ad2-3598425de9c4 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Refreshing network info cache for port 9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG nova.network.neutron [req-b6327497-b8f7-4c2f-a40f-a7fb85d094ba req-ce1cc2cf-5ffb-40a8-8ad2-3598425de9c4 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updated VIF entry in instance network info cache for port 9a58f602-1dd8-46b4-8cc6-f5ef41b44750. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG nova.network.neutron [req-b6327497-b8f7-4c2f-a40f-a7fb85d094ba req-ce1cc2cf-5ffb-40a8-8ad2-3598425de9c4 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updating instance_info_cache with network_info: [{"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b6327497-b8f7-4c2f-a40f-a7fb85d094ba req-ce1cc2cf-5ffb-40a8-8ad2-3598425de9c4 service nova] Releasing lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG os_brick.utils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[305b6c45-3e0b-43d5-8312-ea1550c8e5b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d711764f-afe4-4b85-9ccf-bc09ad1daced]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3befa83f-9389-46fc-bd96-fc5df06fb62d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e5ddf6-b774-4144-9ab4-2099a51e081d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:24:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:24:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:24:26 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:24:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f09569f-1037-45d9-8ee5-5469411ed1b0]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:24:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:24:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:24:26 user nova-compute[73520]: DEBUG os_brick.utils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:24:26 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Updating existing volume attachment record: 61408a6c-a6af-4eca-b4a8-f53b7060cd98 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:24:26 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188651.6578553, 9ab085c8-d666-4525-bee5-d61aada89a7a => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:24:26 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] VM Stopped (Lifecycle Event)
Aug 16 12:24:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cdd7ab2d-b42e-4bd7-80db-3c1905c180e0 None None] [instance: 9ab085c8-d666-4525-bee5-d61aada89a7a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:24:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:24:33 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Creating image(s)
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Ensure instance console log exists: /opt/stack/data/nova/instances/8c32e02c-2cca-46b4-a8e1-0eb854c4cb39/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Start _get_guest_xml network_info=[{"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saNpvoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c32e02c-2cca-46b4-a8e1-0eb854c4cb39', 'attached_at': '', 'detached_at': '', 'volume_id': 'e370c4ce-2c3d-495a-a7c3-f138777b2f20', 'serial': 'e370c4ce-2c3d-495a-a7c3-f138777b2f20'}, 'attachment_id': '54a0e557-c06e-4666-aaea-6d714d4004ee', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:24:33 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:24:33 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saNpvoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:24:33 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:24:33 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:24:33 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c027b017-02dc-406d-9725-e5d67be3fd97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:24:33 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97cbf1f-990a-448f-8ffb-8488231aedd3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20] added
Aug 16 12:24:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d664829-3457-45db-974a-3d55e32db47e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f290e87b-41ac-4aba-94b7-af967eff01e5]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saNpvoES {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saNpvoES" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec83702f-e0a1-4d29-a727-3970e7355eed]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'saNpvoES'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[24655587-f916-4b24-925c-6566954eae3a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b307a92-e25a-4196-be7b-3947a6f1718e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:24:33 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:24:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:24:33 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:24:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a5b3b0-45bc-4a60-b1b4-753199680f8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260]
Aug 16 12:24:33 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260] successful.
Aug 16 12:24:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ef0c20-fb73-445c-8ef5-a83cf1b429f6]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a868fffe-c238-4fce-a8a9-66b43b37d0cb]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:24:33 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:24:33 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:24:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:24:33 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:24:33 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:24:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97bf02b-7d11-49c0-99e8-f0656e2dbfb4]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:24:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saNpvoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:24:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:24:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23062376131663339', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:24:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062376131663339', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-399250487',display_name='tempest-ServerActionsTestOtherA-server-399250487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-399250487',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl3ev6edzI1KLHo1Y5B96ptBm6NSqIbcBOFcMZceXonYnWR3AckvFat7GQrt1EQ+8fQAGMP/p7GDPbXyfJwBrIOn5y+eKTCEQMF2Y9CFOeelDTAPhe+VbqGs9Aw6sueMA==',key_name='tempest-keypair-2118649879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-mvskp7wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=8c32e02c-2cca-46b4-a8e1-0eb854c4cb39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG nova.objects.instance [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:24:35 user nova-compute[73520]:   <uuid>8c32e02c-2cca-46b4-a8e1-0eb854c4cb39</uuid>
Aug 16 12:24:35 user nova-compute[73520]:   <name>instance-00000020</name>
Aug 16 12:24:35 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:24:35 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:24:35 user nova-compute[73520]:   <metadata>
Aug 16 12:24:35 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:24:35 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:24:35 user nova-compute[73520]:       <nova:name>tempest-ServerActionsTestOtherA-server-399250487</nova:name>
Aug 16 12:24:35 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:24:33</nova:creationTime>
Aug 16 12:24:35 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:24:35 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:24:35 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:24:35 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:24:35 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:24:35 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:24:35 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:24:35 user nova-compute[73520]:       <nova:owner>
Aug 16 12:24:35 user nova-compute[73520]:         <nova:user uuid="d2495e37a99546deb000789aac42ed34">tempest-ServerActionsTestOtherA-294187005-project-member</nova:user>
Aug 16 12:24:35 user nova-compute[73520]:         <nova:project uuid="57dd566104a645fd8abda43da8d9b980">tempest-ServerActionsTestOtherA-294187005</nova:project>
Aug 16 12:24:35 user nova-compute[73520]:       </nova:owner>
Aug 16 12:24:35 user nova-compute[73520]:       <nova:ports>
Aug 16 12:24:35 user nova-compute[73520]:         <nova:port uuid="9a58f602-1dd8-46b4-8cc6-f5ef41b44750">
Aug 16 12:24:35 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 12:24:35 user nova-compute[73520]:         </nova:port>
Aug 16 12:24:35 user nova-compute[73520]:       </nova:ports>
Aug 16 12:24:35 user nova-compute[73520]:     </nova:instance>
Aug 16 12:24:35 user nova-compute[73520]:   </metadata>
Aug 16 12:24:35 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:24:35 user nova-compute[73520]:     <system>
Aug 16 12:24:35 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:24:35 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:24:35 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:24:35 user nova-compute[73520]:       <entry name="serial">8c32e02c-2cca-46b4-a8e1-0eb854c4cb39</entry>
Aug 16 12:24:35 user nova-compute[73520]:       <entry name="uuid">8c32e02c-2cca-46b4-a8e1-0eb854c4cb39</entry>
Aug 16 12:24:35 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:24:35 user nova-compute[73520]:     </system>
Aug 16 12:24:35 user nova-compute[73520]:   </sysinfo>
Aug 16 12:24:35 user nova-compute[73520]:   <os>
Aug 16 12:24:35 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:24:35 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:24:35 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:24:35 user nova-compute[73520]:   </os>
Aug 16 12:24:35 user nova-compute[73520]:   <features>
Aug 16 12:24:35 user nova-compute[73520]:     <acpi/>
Aug 16 12:24:35 user nova-compute[73520]:     <apic/>
Aug 16 12:24:35 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:24:35 user nova-compute[73520]:   </features>
Aug 16 12:24:35 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:24:35 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:24:35 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:24:35 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:24:35 user nova-compute[73520]:   </clock>
Aug 16 12:24:35 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:24:35 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:24:35 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:24:35 user nova-compute[73520]:   </cpu>
Aug 16 12:24:35 user nova-compute[73520]:   <devices>
Aug 16 12:24:35 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:24:35 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:24:35 user nova-compute[73520]:       <source dev="/dev/sdb"/>
Aug 16 12:24:35 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:24:35 user nova-compute[73520]:       <serial>e370c4ce-2c3d-495a-a7c3-f138777b2f20</serial>
Aug 16 12:24:35 user nova-compute[73520]:     </disk>
Aug 16 12:24:35 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:24:35 user nova-compute[73520]:       <mac address="fa:16:3e:20:ac:77"/>
Aug 16 12:24:35 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:24:35 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:24:35 user nova-compute[73520]:       <target dev="tap9a58f602-1d"/>
Aug 16 12:24:35 user nova-compute[73520]:     </interface>
Aug 16 12:24:35 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:24:35 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/8c32e02c-2cca-46b4-a8e1-0eb854c4cb39/console.log" append="off"/>
Aug 16 12:24:35 user nova-compute[73520]:     </serial>
Aug 16 12:24:35 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:24:35 user nova-compute[73520]:     <video>
Aug 16 12:24:35 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:24:35 user nova-compute[73520]:     </video>
Aug 16 12:24:35 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:24:35 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:24:35 user nova-compute[73520]:     </rng>
Aug 16 12:24:35 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:24:35 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:24:35 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:24:35 user nova-compute[73520]:     </memballoon>
Aug 16 12:24:35 user nova-compute[73520]:   </devices>
Aug 16 12:24:35 user nova-compute[73520]: </domain>
Aug 16 12:24:35 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-399250487',display_name='tempest-ServerActionsTestOtherA-server-399250487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-399250487',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl3ev6edzI1KLHo1Y5B96ptBm6NSqIbcBOFcMZceXonYnWR3AckvFat7GQrt1EQ+8fQAGMP/p7GDPbXyfJwBrIOn5y+eKTCEQMF2Y9CFOeelDTAPhe+VbqGs9Aw6sueMA==',key_name='tempest-keypair-2118649879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-mvskp7wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=8c32e02c-2cca-46b4-a8e1-0eb854c4cb39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG os_vif [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a58f602-1d, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a58f602-1d, col_values=(('external_ids', {'iface-id': '9a58f602-1dd8-46b4-8cc6-f5ef41b44750', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:ac:77', 'vm-uuid': '8c32e02c-2cca-46b4-a8e1-0eb854c4cb39'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:35 user nova-compute[73520]: INFO os_vif [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d')
Aug 16 12:24:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No VIF found with MAC fa:16:3e:20:ac:77, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:24:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:24:36 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Creating image(s)
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Ensure instance console log exists: /opt/stack/data/nova/instances/927fcd07-08e3-43ba-a6c2-730e0c557311/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Start _get_guest_xml network_info=[{"id": "f3809be6-2f1f-4594-b632-829bfd841717", "address": "fa:16:3e:34:60:18", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3809be6-2f", "ovs_interfaceid": "f3809be6-2f1f-4594-b632-829bfd841717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T12:24:09Z,direct_url=<?>,disk_format='qcow2',id=b82d7e0f-c15f-4b39-a594-99d3a8b209c7,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1071282883',owner='a693cd27934644be8e64731417c66783',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T12:24:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OeLfZlAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '927fcd07-08e3-43ba-a6c2-730e0c557311', 'attached_at': '', 'detached_at': '', 'volume_id': '64dfa341-8c9d-4355-9a32-8ff6f86d1289', 'serial': '64dfa341-8c9d-4355-9a32-8ff6f86d1289'}, 'attachment_id': '61408a6c-a6af-4eca-b4a8-f53b7060cd98', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-da4e187a-e12a-4b9a-a009-c6eefc039a8e req-1b199b86-d551-4bb4-a1cf-92c5d22c28df service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received event network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-da4e187a-e12a-4b9a-a009-c6eefc039a8e req-1b199b86-d551-4bb4-a1cf-92c5d22c28df service nova] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-da4e187a-e12a-4b9a-a009-c6eefc039a8e req-1b199b86-d551-4bb4-a1cf-92c5d22c28df service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-da4e187a-e12a-4b9a-a009-c6eefc039a8e req-1b199b86-d551-4bb4-a1cf-92c5d22c28df service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-da4e187a-e12a-4b9a-a009-c6eefc039a8e req-1b199b86-d551-4bb4-a1cf-92c5d22c28df service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] No waiting events found dispatching network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:24:36 user nova-compute[73520]: WARNING nova.compute.manager [req-da4e187a-e12a-4b9a-a009-c6eefc039a8e req-1b199b86-d551-4bb4-a1cf-92c5d22c28df service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received unexpected event network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 for instance with vm_state building and task_state spawning.
Aug 16 12:24:36 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:24:36 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:24:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T12:24:09Z,direct_url=<?>,disk_format='qcow2',id=b82d7e0f-c15f-4b39-a594-99d3a8b209c7,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1071282883',owner='a693cd27934644be8e64731417c66783',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T12:24:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OeLfZlAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:24:36 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:24:36 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:24:36 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb547cb2-5437-4158-817d-a9b22d3f3627]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:24:36 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd064a1-02d4-454e-bcaf-b26a8f4d147e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289] added
Aug 16 12:24:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[93006dd4-93a9-4214-bfdc-bb39a64877e0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1149eef-771d-49de-a982-f199d0d77098]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OeLfZlAT {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OeLfZlAT" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5c9928-a808-458b-ba8c-05b091ebc3e6]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OeLfZlAT'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b598aae5-3723-4f2c-af81-d0b432aac755]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a34312f-3b05-4b59-8963-ca92bc819ab4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:24:36 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:24:36 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:24:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:24:36 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:24:36 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:24:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76c7753-8638-4010-825a-fdd5448d0d46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289, portal: 172.16.0.220,3260]
Aug 16 12:24:36 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289, portal: 172.16.0.220,3260] successful.
Aug 16 12:24:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d41914c-ace8-4501-97b7-32a747a25337]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeae770-d2d9-41a2-bfc2-4fb9fa38fb27]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:24:36 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:24:36 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:24:36 user nova-compute[73520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)
Aug 16 12:24:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:24:36 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:24:36 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:24:36 user nova-compute[73520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)
Aug 16 12:24:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50741bd-762a-4a5e-abcb-70ceb28d03ef]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:24:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OeLfZlAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23662353030656431', 'path': '/dev/sdd'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662353030656431', 'path': '/dev/sdd'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2071021142',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2071021142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2071021142',id=31,image_ref='b82d7e0f-c15f-4b39-a594-99d3a8b209c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwl0zvuTr+QiKDY3EixulPRdlKIpZGrCEUc8qtl0EDEYrRF08XEGRkINK38At/JrX1qv7U3w19f1em5xoyDbvhq/MXbSuWHuU87OKITzzlXoglty207E2Ql9z7TRKCNig==',key_name='tempest-keypair-1136591830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-x8m0b9k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-496055159',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:24:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ed1823b0de433ab523470e235fdd72',uuid=927fcd07-08e3-43ba-a6c2-730e0c557311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3809be6-2f1f-4594-b632-829bfd841717", "address": "fa:16:3e:34:60:18", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3809be6-2f", "ovs_interfaceid": "f3809be6-2f1f-4594-b632-829bfd841717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "f3809be6-2f1f-4594-b632-829bfd841717", "address": "fa:16:3e:34:60:18", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3809be6-2f", "ovs_interfaceid": "f3809be6-2f1f-4594-b632-829bfd841717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:60:18,bridge_name='br-int',has_traffic_filtering=True,id=f3809be6-2f1f-4594-b632-829bfd841717,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3809be6-2f') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lazy-loading 'pci_devices' on Instance uuid 927fcd07-08e3-43ba-a6c2-730e0c557311 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:24:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:24:37 user nova-compute[73520]:   <uuid>927fcd07-08e3-43ba-a6c2-730e0c557311</uuid>
Aug 16 12:24:37 user nova-compute[73520]:   <name>instance-0000001f</name>
Aug 16 12:24:37 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:24:37 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:24:37 user nova-compute[73520]:   <metadata>
Aug 16 12:24:37 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:24:37 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:24:37 user nova-compute[73520]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2071021142</nova:name>
Aug 16 12:24:37 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:24:36</nova:creationTime>
Aug 16 12:24:37 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:24:37 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:24:37 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:24:37 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:24:37 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:24:37 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:24:37 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:24:37 user nova-compute[73520]:       <nova:owner>
Aug 16 12:24:37 user nova-compute[73520]:         <nova:user uuid="17ed1823b0de433ab523470e235fdd72">tempest-TestVolumeBootPattern-496055159-project-member</nova:user>
Aug 16 12:24:37 user nova-compute[73520]:         <nova:project uuid="a693cd27934644be8e64731417c66783">tempest-TestVolumeBootPattern-496055159</nova:project>
Aug 16 12:24:37 user nova-compute[73520]:       </nova:owner>
Aug 16 12:24:37 user nova-compute[73520]:       <nova:root type="image" uuid="b82d7e0f-c15f-4b39-a594-99d3a8b209c7"/>
Aug 16 12:24:37 user nova-compute[73520]:       <nova:ports>
Aug 16 12:24:37 user nova-compute[73520]:         <nova:port uuid="f3809be6-2f1f-4594-b632-829bfd841717">
Aug 16 12:24:37 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 12:24:37 user nova-compute[73520]:         </nova:port>
Aug 16 12:24:37 user nova-compute[73520]:       </nova:ports>
Aug 16 12:24:37 user nova-compute[73520]:     </nova:instance>
Aug 16 12:24:37 user nova-compute[73520]:   </metadata>
Aug 16 12:24:37 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:24:37 user nova-compute[73520]:     <system>
Aug 16 12:24:37 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:24:37 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:24:37 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:24:37 user nova-compute[73520]:       <entry name="serial">927fcd07-08e3-43ba-a6c2-730e0c557311</entry>
Aug 16 12:24:37 user nova-compute[73520]:       <entry name="uuid">927fcd07-08e3-43ba-a6c2-730e0c557311</entry>
Aug 16 12:24:37 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:24:37 user nova-compute[73520]:     </system>
Aug 16 12:24:37 user nova-compute[73520]:   </sysinfo>
Aug 16 12:24:37 user nova-compute[73520]:   <os>
Aug 16 12:24:37 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:24:37 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:24:37 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:24:37 user nova-compute[73520]:   </os>
Aug 16 12:24:37 user nova-compute[73520]:   <features>
Aug 16 12:24:37 user nova-compute[73520]:     <acpi/>
Aug 16 12:24:37 user nova-compute[73520]:     <apic/>
Aug 16 12:24:37 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:24:37 user nova-compute[73520]:   </features>
Aug 16 12:24:37 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:24:37 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:24:37 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:24:37 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:24:37 user nova-compute[73520]:   </clock>
Aug 16 12:24:37 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:24:37 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:24:37 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:24:37 user nova-compute[73520]:   </cpu>
Aug 16 12:24:37 user nova-compute[73520]:   <devices>
Aug 16 12:24:37 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:24:37 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:24:37 user nova-compute[73520]:       <source dev="/dev/sdd"/>
Aug 16 12:24:37 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:24:37 user nova-compute[73520]:       <serial>64dfa341-8c9d-4355-9a32-8ff6f86d1289</serial>
Aug 16 12:24:37 user nova-compute[73520]:     </disk>
Aug 16 12:24:37 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:24:37 user nova-compute[73520]:       <mac address="fa:16:3e:34:60:18"/>
Aug 16 12:24:37 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:24:37 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:24:37 user nova-compute[73520]:       <target dev="tapf3809be6-2f"/>
Aug 16 12:24:37 user nova-compute[73520]:     </interface>
Aug 16 12:24:37 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:24:37 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/927fcd07-08e3-43ba-a6c2-730e0c557311/console.log" append="off"/>
Aug 16 12:24:37 user nova-compute[73520]:     </serial>
Aug 16 12:24:37 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:24:37 user nova-compute[73520]:     <video>
Aug 16 12:24:37 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:24:37 user nova-compute[73520]:     </video>
Aug 16 12:24:37 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:24:37 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:24:37 user nova-compute[73520]:     </rng>
Aug 16 12:24:37 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:24:37 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:24:37 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:24:37 user nova-compute[73520]:     </memballoon>
Aug 16 12:24:37 user nova-compute[73520]:   </devices>
Aug 16 12:24:37 user nova-compute[73520]: </domain>
Aug 16 12:24:37 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2071021142',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2071021142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2071021142',id=31,image_ref='b82d7e0f-c15f-4b39-a594-99d3a8b209c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwl0zvuTr+QiKDY3EixulPRdlKIpZGrCEUc8qtl0EDEYrRF08XEGRkINK38At/JrX1qv7U3w19f1em5xoyDbvhq/MXbSuWHuU87OKITzzlXoglty207E2Ql9z7TRKCNig==',key_name='tempest-keypair-1136591830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-x8m0b9k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-496055159',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:24:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ed1823b0de433ab523470e235fdd72',uuid=927fcd07-08e3-43ba-a6c2-730e0c557311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3809be6-2f1f-4594-b632-829bfd841717", "address": "fa:16:3e:34:60:18", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3809be6-2f", "ovs_interfaceid": "f3809be6-2f1f-4594-b632-829bfd841717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "f3809be6-2f1f-4594-b632-829bfd841717", "address": "fa:16:3e:34:60:18", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3809be6-2f", "ovs_interfaceid": "f3809be6-2f1f-4594-b632-829bfd841717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:60:18,bridge_name='br-int',has_traffic_filtering=True,id=f3809be6-2f1f-4594-b632-829bfd841717,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3809be6-2f') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG os_vif [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:60:18,bridge_name='br-int',has_traffic_filtering=True,id=f3809be6-2f1f-4594-b632-829bfd841717,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3809be6-2f') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3809be6-2f, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3809be6-2f, col_values=(('external_ids', {'iface-id': 'f3809be6-2f1f-4594-b632-829bfd841717', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:60:18', 'vm-uuid': '927fcd07-08e3-43ba-a6c2-730e0c557311'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:38 user nova-compute[73520]: INFO os_vif [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:60:18,bridge_name='br-int',has_traffic_filtering=True,id=f3809be6-2f1f-4594-b632-829bfd841717,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3809be6-2f')
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] No VIF found with MAC fa:16:3e:34:60:18, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188678.4197161, 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:24:38 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] VM Resumed (Lifecycle Event)
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:24:38 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Instance spawned successfully.
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:38 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188678.428316, 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:24:38 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] VM Started (Lifecycle Event)
Aug 16 12:24:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:24:38 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:24:38 user nova-compute[73520]: INFO nova.compute.manager [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Took 4.96 seconds to spawn the instance on the hypervisor.
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-c995ecaf-91c2-4bb8-8493-2b13edd17567 req-ef8db636-9932-4bfa-8092-e81c4d4970bc service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received event network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c995ecaf-91c2-4bb8-8493-2b13edd17567 req-ef8db636-9932-4bfa-8092-e81c4d4970bc service nova] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c995ecaf-91c2-4bb8-8493-2b13edd17567 req-ef8db636-9932-4bfa-8092-e81c4d4970bc service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c995ecaf-91c2-4bb8-8493-2b13edd17567 req-ef8db636-9932-4bfa-8092-e81c4d4970bc service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-c995ecaf-91c2-4bb8-8493-2b13edd17567 req-ef8db636-9932-4bfa-8092-e81c4d4970bc service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] No waiting events found dispatching network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:24:38 user nova-compute[73520]: WARNING nova.compute.manager [req-c995ecaf-91c2-4bb8-8493-2b13edd17567 req-ef8db636-9932-4bfa-8092-e81c4d4970bc service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received unexpected event network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 for instance with vm_state building and task_state spawning.
Aug 16 12:24:38 user nova-compute[73520]: INFO nova.compute.manager [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Took 16.43 seconds to build instance.
Aug 16 12:24:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-058bb34a-6e44-42c0-a7e4-39232b2f5b2b tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.539s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:24:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-6e9e5edb-f78e-406b-9992-f08046c626c4 req-d364e57d-98ea-4720-b899-2f87283f824c service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received event network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6e9e5edb-f78e-406b-9992-f08046c626c4 req-d364e57d-98ea-4720-b899-2f87283f824c service nova] Acquiring lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6e9e5edb-f78e-406b-9992-f08046c626c4 req-d364e57d-98ea-4720-b899-2f87283f824c service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6e9e5edb-f78e-406b-9992-f08046c626c4 req-d364e57d-98ea-4720-b899-2f87283f824c service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-6e9e5edb-f78e-406b-9992-f08046c626c4 req-d364e57d-98ea-4720-b899-2f87283f824c service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] No waiting events found dispatching network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:24:40 user nova-compute[73520]: WARNING nova.compute.manager [req-6e9e5edb-f78e-406b-9992-f08046c626c4 req-d364e57d-98ea-4720-b899-2f87283f824c service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received unexpected event network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 for instance with vm_state building and task_state spawning.
Aug 16 12:24:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-6e9e5edb-f78e-406b-9992-f08046c626c4 req-d364e57d-98ea-4720-b899-2f87283f824c service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received event network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6e9e5edb-f78e-406b-9992-f08046c626c4 req-d364e57d-98ea-4720-b899-2f87283f824c service nova] Acquiring lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6e9e5edb-f78e-406b-9992-f08046c626c4 req-d364e57d-98ea-4720-b899-2f87283f824c service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6e9e5edb-f78e-406b-9992-f08046c626c4 req-d364e57d-98ea-4720-b899-2f87283f824c service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-6e9e5edb-f78e-406b-9992-f08046c626c4 req-d364e57d-98ea-4720-b899-2f87283f824c service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] No waiting events found dispatching network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:24:40 user nova-compute[73520]: WARNING nova.compute.manager [req-6e9e5edb-f78e-406b-9992-f08046c626c4 req-d364e57d-98ea-4720-b899-2f87283f824c service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received unexpected event network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 for instance with vm_state building and task_state spawning.
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:24:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188681.5410535, 927fcd07-08e3-43ba-a6c2-730e0c557311 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:24:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] VM Resumed (Lifecycle Event)
Aug 16 12:24:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:24:41 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Instance spawned successfully.
Aug 16 12:24:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:24:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:24:41 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188681.5429556, 927fcd07-08e3-43ba-a6c2-730e0c557311 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:24:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] VM Started (Lifecycle Event)
Aug 16 12:24:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:24:41 user nova-compute[73520]: INFO nova.compute.manager [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 16 12:24:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:24:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:24:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:41 user nova-compute[73520]: INFO nova.compute.manager [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Took 22.20 seconds to build instance.
Aug 16 12:24:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-02f422d9-ebf7-4f84-8d93-45e26fa541ce tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.321s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:43 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:24:43 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7413MB free_disk=25.387557983398438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 91e479f7-5fc0-46d2-9c02-52175084fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance e0c2b937-066a-490f-a2a2-57ae3dfe814b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance fa037e15-3751-4088-9607-e2bb2a8d4f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 927fcd07-08e3-43ba-a6c2-730e0c557311 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:24:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:24:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:24:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:24:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:24:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:24:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:24:44 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:24:44 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 443357b7-2fc9-4ac7-8fce-7dc2bede4369 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:24:45 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updating instance_info_cache with network_info: [{"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:24:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:24:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:24:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:24:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:24:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:48 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:24:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:48 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:24:48 user nova-compute[73520]: INFO nova.compute.claims [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Claim successful on node user
Aug 16 12:24:48 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:24:48 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:24:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:48 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:24:49 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:24:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG nova.policy [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7e48ee408e24af083b40b19437cfbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed29e455a840474b8a1407af538883ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:24:49 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Creating image(s)
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "/opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "/opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "/opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.262s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.192s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk 1073741824" returned: 0 in 0.050s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.197s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:24:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:24:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:24:50 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Cannot resize image /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:24:50 user nova-compute[73520]: DEBUG nova.objects.instance [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'migration_context' on Instance uuid 61633714-d25e-4cde-b757-b3c3f6fd8d71 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:24:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:24:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Ensure instance console log exists: /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:24:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:50 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Successfully created port: e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Successfully updated port: e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquired lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-677fce4c-2a7f-4de2-8a10-cfecba856bff req-1710c239-9926-4fb9-9bed-8e7aee10f7c5 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received event network-changed-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-677fce4c-2a7f-4de2-8a10-cfecba856bff req-1710c239-9926-4fb9-9bed-8e7aee10f7c5 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Refreshing instance network info cache due to event network-changed-e230cf5f-ff43-476e-b808-41f0c3f11963. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-677fce4c-2a7f-4de2-8a10-cfecba856bff req-1710c239-9926-4fb9-9bed-8e7aee10f7c5 service nova] Acquiring lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Updating instance_info_cache with network_info: [{"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Releasing lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Instance network_info: |[{"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-677fce4c-2a7f-4de2-8a10-cfecba856bff req-1710c239-9926-4fb9-9bed-8e7aee10f7c5 service nova] Acquired lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG nova.network.neutron [req-677fce4c-2a7f-4de2-8a10-cfecba856bff req-1710c239-9926-4fb9-9bed-8e7aee10f7c5 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Refreshing network info cache for port e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:24:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Start _get_guest_xml network_info=[{"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:24:52 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:24:52 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1180361508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1180361508',id=33,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfkEYZLGDx6EYezKN4oK9B9wCW5phyLrCizSqon9tcojC71hDzlZRPIPlCl3qnE+Uq7R7KhXw33/MHXWNmk8GveZToBVft7dR+WRJyJmNOWzjTlp/G3pP44YVDI8bKFtg==',key_name='tempest-keypair-1175824880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed29e455a840474b8a1407af538883ab',ramdisk_id='',reservation_id='r-70vxdm7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-974908846',owner_user_name='tempest-AttachVolumeShelveTestJSON-974908846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:24:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7e48ee408e24af083b40b19437cfbac',uuid=61633714-d25e-4cde-b757-b3c3f6fd8d71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converting VIF {"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.objects.instance [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'pci_devices' on Instance uuid 61633714-d25e-4cde-b757-b3c3f6fd8d71 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:24:52 user nova-compute[73520]:   <uuid>61633714-d25e-4cde-b757-b3c3f6fd8d71</uuid>
Aug 16 12:24:52 user nova-compute[73520]:   <name>instance-00000021</name>
Aug 16 12:24:52 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:24:52 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:24:52 user nova-compute[73520]:   <metadata>
Aug 16 12:24:52 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:24:52 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:24:52 user nova-compute[73520]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1180361508</nova:name>
Aug 16 12:24:52 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:24:52</nova:creationTime>
Aug 16 12:24:52 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:24:52 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:24:52 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:24:52 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:24:52 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:24:52 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:24:52 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:24:52 user nova-compute[73520]:       <nova:owner>
Aug 16 12:24:52 user nova-compute[73520]:         <nova:user uuid="b7e48ee408e24af083b40b19437cfbac">tempest-AttachVolumeShelveTestJSON-974908846-project-member</nova:user>
Aug 16 12:24:52 user nova-compute[73520]:         <nova:project uuid="ed29e455a840474b8a1407af538883ab">tempest-AttachVolumeShelveTestJSON-974908846</nova:project>
Aug 16 12:24:52 user nova-compute[73520]:       </nova:owner>
Aug 16 12:24:52 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:24:52 user nova-compute[73520]:       <nova:ports>
Aug 16 12:24:52 user nova-compute[73520]:         <nova:port uuid="e230cf5f-ff43-476e-b808-41f0c3f11963">
Aug 16 12:24:52 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 12:24:52 user nova-compute[73520]:         </nova:port>
Aug 16 12:24:52 user nova-compute[73520]:       </nova:ports>
Aug 16 12:24:52 user nova-compute[73520]:     </nova:instance>
Aug 16 12:24:52 user nova-compute[73520]:   </metadata>
Aug 16 12:24:52 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:24:52 user nova-compute[73520]:     <system>
Aug 16 12:24:52 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:24:52 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:24:52 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:24:52 user nova-compute[73520]:       <entry name="serial">61633714-d25e-4cde-b757-b3c3f6fd8d71</entry>
Aug 16 12:24:52 user nova-compute[73520]:       <entry name="uuid">61633714-d25e-4cde-b757-b3c3f6fd8d71</entry>
Aug 16 12:24:52 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:24:52 user nova-compute[73520]:     </system>
Aug 16 12:24:52 user nova-compute[73520]:   </sysinfo>
Aug 16 12:24:52 user nova-compute[73520]:   <os>
Aug 16 12:24:52 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:24:52 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:24:52 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:24:52 user nova-compute[73520]:   </os>
Aug 16 12:24:52 user nova-compute[73520]:   <features>
Aug 16 12:24:52 user nova-compute[73520]:     <acpi/>
Aug 16 12:24:52 user nova-compute[73520]:     <apic/>
Aug 16 12:24:52 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:24:52 user nova-compute[73520]:   </features>
Aug 16 12:24:52 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:24:52 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:24:52 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:24:52 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:24:52 user nova-compute[73520]:   </clock>
Aug 16 12:24:52 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:24:52 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:24:52 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:24:52 user nova-compute[73520]:   </cpu>
Aug 16 12:24:52 user nova-compute[73520]:   <devices>
Aug 16 12:24:52 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:24:52 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:24:52 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk"/>
Aug 16 12:24:52 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:24:52 user nova-compute[73520]:     </disk>
Aug 16 12:24:52 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:24:52 user nova-compute[73520]:       <mac address="fa:16:3e:6b:ec:94"/>
Aug 16 12:24:52 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:24:52 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:24:52 user nova-compute[73520]:       <target dev="tape230cf5f-ff"/>
Aug 16 12:24:52 user nova-compute[73520]:     </interface>
Aug 16 12:24:52 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:24:52 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/console.log" append="off"/>
Aug 16 12:24:52 user nova-compute[73520]:     </serial>
Aug 16 12:24:52 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:24:52 user nova-compute[73520]:     <video>
Aug 16 12:24:52 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:24:52 user nova-compute[73520]:     </video>
Aug 16 12:24:52 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:24:52 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:24:52 user nova-compute[73520]:     </rng>
Aug 16 12:24:52 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:24:52 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:24:52 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:24:52 user nova-compute[73520]:     </memballoon>
Aug 16 12:24:52 user nova-compute[73520]:   </devices>
Aug 16 12:24:52 user nova-compute[73520]: </domain>
Aug 16 12:24:52 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1180361508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1180361508',id=33,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfkEYZLGDx6EYezKN4oK9B9wCW5phyLrCizSqon9tcojC71hDzlZRPIPlCl3qnE+Uq7R7KhXw33/MHXWNmk8GveZToBVft7dR+WRJyJmNOWzjTlp/G3pP44YVDI8bKFtg==',key_name='tempest-keypair-1175824880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed29e455a840474b8a1407af538883ab',ramdisk_id='',reservation_id='r-70vxdm7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-974908846',owner_user_name='tempest-AttachVolumeShelveTestJSON-974908846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:24:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7e48ee408e24af083b40b19437cfbac',uuid=61633714-d25e-4cde-b757-b3c3f6fd8d71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converting VIF {"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG os_vif [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape230cf5f-ff, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape230cf5f-ff, col_values=(('external_ids', {'iface-id': 'e230cf5f-ff43-476e-b808-41f0c3f11963', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:ec:94', 'vm-uuid': '61633714-d25e-4cde-b757-b3c3f6fd8d71'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:52 user nova-compute[73520]: INFO os_vif [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff')
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] No VIF found with MAC fa:16:3e:6b:ec:94, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.network.neutron [req-677fce4c-2a7f-4de2-8a10-cfecba856bff req-1710c239-9926-4fb9-9bed-8e7aee10f7c5 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Updated VIF entry in instance network info cache for port e230cf5f-ff43-476e-b808-41f0c3f11963. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG nova.network.neutron [req-677fce4c-2a7f-4de2-8a10-cfecba856bff req-1710c239-9926-4fb9-9bed-8e7aee10f7c5 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Updating instance_info_cache with network_info: [{"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:24:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-677fce4c-2a7f-4de2-8a10-cfecba856bff req-1710c239-9926-4fb9-9bed-8e7aee10f7c5 service nova] Releasing lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:24:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-bc0f4862-c22e-432e-9314-7358c7d84e5a req-3dcbdefb-0f71-4df7-a9d2-2224444f87aa service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received event network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:24:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bc0f4862-c22e-432e-9314-7358c7d84e5a req-3dcbdefb-0f71-4df7-a9d2-2224444f87aa service nova] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bc0f4862-c22e-432e-9314-7358c7d84e5a req-3dcbdefb-0f71-4df7-a9d2-2224444f87aa service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bc0f4862-c22e-432e-9314-7358c7d84e5a req-3dcbdefb-0f71-4df7-a9d2-2224444f87aa service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-bc0f4862-c22e-432e-9314-7358c7d84e5a req-3dcbdefb-0f71-4df7-a9d2-2224444f87aa service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] No waiting events found dispatching network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:24:54 user nova-compute[73520]: WARNING nova.compute.manager [req-bc0f4862-c22e-432e-9314-7358c7d84e5a req-3dcbdefb-0f71-4df7-a9d2-2224444f87aa service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received unexpected event network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 for instance with vm_state building and task_state spawning.
Aug 16 12:24:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-8f43bded-03bc-4f33-b492-24f258a1514e req-016dded6-c875-4a12-9e02-4e03a0a01c39 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received event network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8f43bded-03bc-4f33-b492-24f258a1514e req-016dded6-c875-4a12-9e02-4e03a0a01c39 service nova] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8f43bded-03bc-4f33-b492-24f258a1514e req-016dded6-c875-4a12-9e02-4e03a0a01c39 service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8f43bded-03bc-4f33-b492-24f258a1514e req-016dded6-c875-4a12-9e02-4e03a0a01c39 service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-8f43bded-03bc-4f33-b492-24f258a1514e req-016dded6-c875-4a12-9e02-4e03a0a01c39 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] No waiting events found dispatching network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:24:56 user nova-compute[73520]: WARNING nova.compute.manager [req-8f43bded-03bc-4f33-b492-24f258a1514e req-016dded6-c875-4a12-9e02-4e03a0a01c39 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received unexpected event network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 for instance with vm_state building and task_state spawning.
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188696.1359248, 61633714-d25e-4cde-b757-b3c3f6fd8d71 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:24:56 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] VM Resumed (Lifecycle Event)
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:24:56 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Instance spawned successfully.
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:24:56 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188696.13884, 61633714-d25e-4cde-b757-b3c3f6fd8d71 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:24:56 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] VM Started (Lifecycle Event)
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:24:56 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:24:56 user nova-compute[73520]: INFO nova.compute.manager [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Took 7.06 seconds to spawn the instance on the hypervisor.
Aug 16 12:24:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:24:56 user nova-compute[73520]: INFO nova.compute.manager [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Took 8.19 seconds to build instance.
Aug 16 12:24:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4798406e-4405-4eee-9530-7f7d85805c50 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.311s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:24:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:24:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:21 user nova-compute[73520]: INFO nova.compute.manager [None req-be8571a1-8a44-422f-815b-33e74bb891e9 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Unrescuing
Aug 16 12:25:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-be8571a1-8a44-422f-815b-33e74bb891e9 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:25:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-be8571a1-8a44-422f-815b-33e74bb891e9 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquired lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:25:21 user nova-compute[73520]: DEBUG nova.network.neutron [None req-be8571a1-8a44-422f-815b-33e74bb891e9 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:25:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:22 user nova-compute[73520]: DEBUG nova.network.neutron [None req-be8571a1-8a44-422f-815b-33e74bb891e9 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Updating instance_info_cache with network_info: [{"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:25:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-be8571a1-8a44-422f-815b-33e74bb891e9 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Releasing lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:25:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-be8571a1-8a44-422f-815b-33e74bb891e9 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'flavor' on Instance uuid ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:25:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:23 user nova-compute[73520]: DEBUG nova.compute.manager [req-ebc79d94-b22e-4ed3-af0e-0e9f8d4634f1 req-930c863a-418c-4fa9-96dc-1c2617451d11 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-unplugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:25:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ebc79d94-b22e-4ed3-af0e-0e9f8d4634f1 req-930c863a-418c-4fa9-96dc-1c2617451d11 service nova] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ebc79d94-b22e-4ed3-af0e-0e9f8d4634f1 req-930c863a-418c-4fa9-96dc-1c2617451d11 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ebc79d94-b22e-4ed3-af0e-0e9f8d4634f1 req-930c863a-418c-4fa9-96dc-1c2617451d11 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:23 user nova-compute[73520]: DEBUG nova.compute.manager [req-ebc79d94-b22e-4ed3-af0e-0e9f8d4634f1 req-930c863a-418c-4fa9-96dc-1c2617451d11 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] No waiting events found dispatching network-vif-unplugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:25:23 user nova-compute[73520]: WARNING nova.compute.manager [req-ebc79d94-b22e-4ed3-af0e-0e9f8d4634f1 req-930c863a-418c-4fa9-96dc-1c2617451d11 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received unexpected event network-vif-unplugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:25:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:24 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Instance destroyed successfully.
Aug 16 12:25:25 user nova-compute[73520]: DEBUG nova.compute.manager [req-b84332fc-beb7-47d9-991c-6b18cd0994be req-e5adc067-6bb8-4b0c-b486-b766063ae217 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:25:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b84332fc-beb7-47d9-991c-6b18cd0994be req-e5adc067-6bb8-4b0c-b486-b766063ae217 service nova] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b84332fc-beb7-47d9-991c-6b18cd0994be req-e5adc067-6bb8-4b0c-b486-b766063ae217 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b84332fc-beb7-47d9-991c-6b18cd0994be req-e5adc067-6bb8-4b0c-b486-b766063ae217 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:25 user nova-compute[73520]: DEBUG nova.compute.manager [req-b84332fc-beb7-47d9-991c-6b18cd0994be req-e5adc067-6bb8-4b0c-b486-b766063ae217 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] No waiting events found dispatching network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:25:25 user nova-compute[73520]: WARNING nova.compute.manager [req-b84332fc-beb7-47d9-991c-6b18cd0994be req-e5adc067-6bb8-4b0c-b486-b766063ae217 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received unexpected event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:25:25 user nova-compute[73520]: DEBUG nova.compute.manager [req-32e7b751-c33d-4fa4-96fd-af5654a40450 req-e252001b-141f-4469-9712-5ec36bfe7462 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Received event network-changed-fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:25:25 user nova-compute[73520]: DEBUG nova.compute.manager [req-32e7b751-c33d-4fa4-96fd-af5654a40450 req-e252001b-141f-4469-9712-5ec36bfe7462 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Refreshing instance network info cache due to event network-changed-fd32a4f5-3408-4338-ac44-3253c58f650a. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:25:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32e7b751-c33d-4fa4-96fd-af5654a40450 req-e252001b-141f-4469-9712-5ec36bfe7462 service nova] Acquiring lock "refresh_cache-fa037e15-3751-4088-9607-e2bb2a8d4f01" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:25:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32e7b751-c33d-4fa4-96fd-af5654a40450 req-e252001b-141f-4469-9712-5ec36bfe7462 service nova] Acquired lock "refresh_cache-fa037e15-3751-4088-9607-e2bb2a8d4f01" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:25:25 user nova-compute[73520]: DEBUG nova.network.neutron [req-32e7b751-c33d-4fa4-96fd-af5654a40450 req-e252001b-141f-4469-9712-5ec36bfe7462 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Refreshing network info cache for port fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:25:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:26 user nova-compute[73520]: DEBUG nova.network.neutron [req-32e7b751-c33d-4fa4-96fd-af5654a40450 req-e252001b-141f-4469-9712-5ec36bfe7462 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Updated VIF entry in instance network info cache for port fd32a4f5-3408-4338-ac44-3253c58f650a. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:25:26 user nova-compute[73520]: DEBUG nova.network.neutron [req-32e7b751-c33d-4fa4-96fd-af5654a40450 req-e252001b-141f-4469-9712-5ec36bfe7462 service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Updating instance_info_cache with network_info: [{"id": "fd32a4f5-3408-4338-ac44-3253c58f650a", "address": "fa:16:3e:e2:0e:27", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32a4f5-34", "ovs_interfaceid": "fd32a4f5-3408-4338-ac44-3253c58f650a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:25:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32e7b751-c33d-4fa4-96fd-af5654a40450 req-e252001b-141f-4469-9712-5ec36bfe7462 service nova] Releasing lock "refresh_cache-fa037e15-3751-4088-9607-e2bb2a8d4f01" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:25:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-a7509e3b-2f0b-43ba-afa5-5d4b4eb83942 req-05ef8077-eb2a-4b57-8251-91cc78f6e8b8 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:25:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a7509e3b-2f0b-43ba-afa5-5d4b4eb83942 req-05ef8077-eb2a-4b57-8251-91cc78f6e8b8 service nova] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a7509e3b-2f0b-43ba-afa5-5d4b4eb83942 req-05ef8077-eb2a-4b57-8251-91cc78f6e8b8 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a7509e3b-2f0b-43ba-afa5-5d4b4eb83942 req-05ef8077-eb2a-4b57-8251-91cc78f6e8b8 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-a7509e3b-2f0b-43ba-afa5-5d4b4eb83942 req-05ef8077-eb2a-4b57-8251-91cc78f6e8b8 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] No waiting events found dispatching network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:25:27 user nova-compute[73520]: WARNING nova.compute.manager [req-a7509e3b-2f0b-43ba-afa5-5d4b4eb83942 req-05ef8077-eb2a-4b57-8251-91cc78f6e8b8 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received unexpected event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:25:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-a7509e3b-2f0b-43ba-afa5-5d4b4eb83942 req-05ef8077-eb2a-4b57-8251-91cc78f6e8b8 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:25:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a7509e3b-2f0b-43ba-afa5-5d4b4eb83942 req-05ef8077-eb2a-4b57-8251-91cc78f6e8b8 service nova] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a7509e3b-2f0b-43ba-afa5-5d4b4eb83942 req-05ef8077-eb2a-4b57-8251-91cc78f6e8b8 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a7509e3b-2f0b-43ba-afa5-5d4b4eb83942 req-05ef8077-eb2a-4b57-8251-91cc78f6e8b8 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-a7509e3b-2f0b-43ba-afa5-5d4b4eb83942 req-05ef8077-eb2a-4b57-8251-91cc78f6e8b8 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] No waiting events found dispatching network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:25:27 user nova-compute[73520]: WARNING nova.compute.manager [req-a7509e3b-2f0b-43ba-afa5-5d4b4eb83942 req-05ef8077-eb2a-4b57-8251-91cc78f6e8b8 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received unexpected event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:25:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "27659935-6eb3-4cea-9648-f5820cddda98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Removed pending event for ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 due to event {{(pid=73520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188728.2870913, ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:25:28 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] VM Resumed (Lifecycle Event)
Aug 16 12:25:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-be8571a1-8a44-422f-815b-33e74bb891e9 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:25:28 user nova-compute[73520]: INFO nova.compute.claims [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Claim successful on node user
Aug 16 12:25:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:25:28 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 12:25:28 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188728.2903733, ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:25:28 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] VM Started (Lifecycle Event)
Aug 16 12:25:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.703s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:25:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:25:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:25:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG nova.policy [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '354985a41cf846dab967f7d238e19319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65805b8eab71460caf571e52648c40d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:25:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Creating image(s)
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "/opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "/opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "/opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.231s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.213s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk 1073741824" returned: 0 in 0.052s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.175s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:25:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:30 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Cannot resize image /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:25:30 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lazy-loading 'migration_context' on Instance uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:25:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:25:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Ensure instance console log exists: /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:25:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:30 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Successfully created port: 8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:25:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:30 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'flavor' on Instance uuid fa037e15-3751-4088-9607-e2bb2a8d4f01 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:25:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:31 user nova-compute[73520]: INFO nova.compute.manager [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Attaching volume 84a8d25a-e766-4cee-b417-b3032a0d391b to /dev/vdb
Aug 16 12:25:31 user nova-compute[73520]: DEBUG os_brick.utils [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adb6688-3753-478b-919f-7141a6c45388]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e64e55-7cd4-4baa-b06c-1edeaa749554]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[810dee30-f9d1-41c5-bf18-bbe6250e3835]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1ca256-6f00-4924-ac81-1fa80563be50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:25:31 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1ccaf4-81eb-440a-ac26-016c2f1a671c]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG os_brick.utils [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Updating existing volume attachment record: a930a020-217b-4504-8544-82dfdf58484b {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Successfully updated port: 8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquired lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-7842450c-52fa-472e-8c44-8bcb2fbc7894 req-a1da73e2-e908-4a14-8975-585db503ac80 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-changed-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-7842450c-52fa-472e-8c44-8bcb2fbc7894 req-a1da73e2-e908-4a14-8975-585db503ac80 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Refreshing instance network info cache due to event network-changed-8018c557-722c-41a7-91e0-f63bc6568bac. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7842450c-52fa-472e-8c44-8bcb2fbc7894 req-a1da73e2-e908-4a14-8975-585db503ac80 service nova] Acquiring lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating instance_info_cache with network_info: [{"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Releasing lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Instance network_info: |[{"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7842450c-52fa-472e-8c44-8bcb2fbc7894 req-a1da73e2-e908-4a14-8975-585db503ac80 service nova] Acquired lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.network.neutron [req-7842450c-52fa-472e-8c44-8bcb2fbc7894 req-a1da73e2-e908-4a14-8975-585db503ac80 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Refreshing network info cache for port 8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Start _get_guest_xml network_info=[{"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:25:31 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:25:31 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:25:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-576632488',display_name='tempest-ServerActionsTestOtherB-server-576632488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-576632488',id=34,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa+wt9FJevF0VcG5IW9UPpcwllZecsxipO+cOwPONy0JXrxwIIn5VueYzwt5Y4Fz26HPB5B2yhLRiuQ1H/JJF0RqBlDYiGwQFxVVbFuKbbBpDS5B0RYzbNj/n52YCPO2A==',key_name='tempest-keypair-872928149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65805b8eab71460caf571e52648c40d4',ramdisk_id='',reservation_id='r-54clw1uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1849139886',owner_user_name='tempest-ServerActionsTestOtherB-1849139886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='354985a41cf846dab967f7d238e19319',uuid=27659935-6eb3-4cea-9648-f5820cddda98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converting VIF {"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lazy-loading 'pci_devices' on Instance uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:25:31 user nova-compute[73520]:   <uuid>27659935-6eb3-4cea-9648-f5820cddda98</uuid>
Aug 16 12:25:31 user nova-compute[73520]:   <name>instance-00000022</name>
Aug 16 12:25:31 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:25:31 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:25:31 user nova-compute[73520]:   <metadata>
Aug 16 12:25:31 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:25:31 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:25:31 user nova-compute[73520]:       <nova:name>tempest-ServerActionsTestOtherB-server-576632488</nova:name>
Aug 16 12:25:31 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:25:31</nova:creationTime>
Aug 16 12:25:31 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:25:31 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:25:31 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:25:31 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:25:31 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:25:31 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:25:31 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:25:31 user nova-compute[73520]:       <nova:owner>
Aug 16 12:25:31 user nova-compute[73520]:         <nova:user uuid="354985a41cf846dab967f7d238e19319">tempest-ServerActionsTestOtherB-1849139886-project-member</nova:user>
Aug 16 12:25:31 user nova-compute[73520]:         <nova:project uuid="65805b8eab71460caf571e52648c40d4">tempest-ServerActionsTestOtherB-1849139886</nova:project>
Aug 16 12:25:31 user nova-compute[73520]:       </nova:owner>
Aug 16 12:25:31 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:25:31 user nova-compute[73520]:       <nova:ports>
Aug 16 12:25:31 user nova-compute[73520]:         <nova:port uuid="8018c557-722c-41a7-91e0-f63bc6568bac">
Aug 16 12:25:31 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 12:25:31 user nova-compute[73520]:         </nova:port>
Aug 16 12:25:31 user nova-compute[73520]:       </nova:ports>
Aug 16 12:25:31 user nova-compute[73520]:     </nova:instance>
Aug 16 12:25:31 user nova-compute[73520]:   </metadata>
Aug 16 12:25:31 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:25:31 user nova-compute[73520]:     <system>
Aug 16 12:25:31 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:25:31 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:25:31 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:25:31 user nova-compute[73520]:       <entry name="serial">27659935-6eb3-4cea-9648-f5820cddda98</entry>
Aug 16 12:25:31 user nova-compute[73520]:       <entry name="uuid">27659935-6eb3-4cea-9648-f5820cddda98</entry>
Aug 16 12:25:31 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:25:31 user nova-compute[73520]:     </system>
Aug 16 12:25:31 user nova-compute[73520]:   </sysinfo>
Aug 16 12:25:31 user nova-compute[73520]:   <os>
Aug 16 12:25:31 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:25:31 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:25:31 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:25:31 user nova-compute[73520]:   </os>
Aug 16 12:25:31 user nova-compute[73520]:   <features>
Aug 16 12:25:31 user nova-compute[73520]:     <acpi/>
Aug 16 12:25:31 user nova-compute[73520]:     <apic/>
Aug 16 12:25:31 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:25:31 user nova-compute[73520]:   </features>
Aug 16 12:25:31 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:25:31 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:25:31 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:25:31 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:25:31 user nova-compute[73520]:   </clock>
Aug 16 12:25:31 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:25:31 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:25:31 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:25:31 user nova-compute[73520]:   </cpu>
Aug 16 12:25:31 user nova-compute[73520]:   <devices>
Aug 16 12:25:31 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:25:31 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:25:31 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk"/>
Aug 16 12:25:31 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:25:31 user nova-compute[73520]:     </disk>
Aug 16 12:25:31 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:25:31 user nova-compute[73520]:       <mac address="fa:16:3e:e5:78:5d"/>
Aug 16 12:25:31 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:25:31 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:25:31 user nova-compute[73520]:       <target dev="tap8018c557-72"/>
Aug 16 12:25:31 user nova-compute[73520]:     </interface>
Aug 16 12:25:31 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:25:31 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/console.log" append="off"/>
Aug 16 12:25:31 user nova-compute[73520]:     </serial>
Aug 16 12:25:31 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:25:31 user nova-compute[73520]:     <video>
Aug 16 12:25:31 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:25:31 user nova-compute[73520]:     </video>
Aug 16 12:25:31 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:25:31 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:25:31 user nova-compute[73520]:     </rng>
Aug 16 12:25:31 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:25:31 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:25:31 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:25:31 user nova-compute[73520]:     </memballoon>
Aug 16 12:25:31 user nova-compute[73520]:   </devices>
Aug 16 12:25:31 user nova-compute[73520]: </domain>
Aug 16 12:25:31 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:25:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-576632488',display_name='tempest-ServerActionsTestOtherB-server-576632488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-576632488',id=34,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa+wt9FJevF0VcG5IW9UPpcwllZecsxipO+cOwPONy0JXrxwIIn5VueYzwt5Y4Fz26HPB5B2yhLRiuQ1H/JJF0RqBlDYiGwQFxVVbFuKbbBpDS5B0RYzbNj/n52YCPO2A==',key_name='tempest-keypair-872928149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65805b8eab71460caf571e52648c40d4',ramdisk_id='',reservation_id='r-54clw1uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1849139886',owner_user_name='tempest-ServerActionsTestOtherB-1849139886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='354985a41cf846dab967f7d238e19319',uuid=27659935-6eb3-4cea-9648-f5820cddda98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converting VIF {"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG os_vif [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8018c557-72, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8018c557-72, col_values=(('external_ids', {'iface-id': '8018c557-722c-41a7-91e0-f63bc6568bac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:78:5d', 'vm-uuid': '27659935-6eb3-4cea-9648-f5820cddda98'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:31 user nova-compute[73520]: INFO os_vif [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72')
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:25:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] No VIF found with MAC fa:16:3e:e5:78:5d, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:25:32 user nova-compute[73520]: DEBUG nova.network.neutron [req-7842450c-52fa-472e-8c44-8bcb2fbc7894 req-a1da73e2-e908-4a14-8975-585db503ac80 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updated VIF entry in instance network info cache for port 8018c557-722c-41a7-91e0-f63bc6568bac. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:25:32 user nova-compute[73520]: DEBUG nova.network.neutron [req-7842450c-52fa-472e-8c44-8bcb2fbc7894 req-a1da73e2-e908-4a14-8975-585db503ac80 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating instance_info_cache with network_info: [{"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:25:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7842450c-52fa-472e-8c44-8bcb2fbc7894 req-a1da73e2-e908-4a14-8975-585db503ac80 service nova] Releasing lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:25:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-d74a61a7-ed20-4f37-a2e4-36a206e4453e req-c5bf3166-645b-4b7c-acf3-19ea9d7dc879 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:25:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d74a61a7-ed20-4f37-a2e4-36a206e4453e req-c5bf3166-645b-4b7c-acf3-19ea9d7dc879 service nova] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d74a61a7-ed20-4f37-a2e4-36a206e4453e req-c5bf3166-645b-4b7c-acf3-19ea9d7dc879 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d74a61a7-ed20-4f37-a2e4-36a206e4453e req-c5bf3166-645b-4b7c-acf3-19ea9d7dc879 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-d74a61a7-ed20-4f37-a2e4-36a206e4453e req-c5bf3166-645b-4b7c-acf3-19ea9d7dc879 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] No waiting events found dispatching network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:25:33 user nova-compute[73520]: WARNING nova.compute.manager [req-d74a61a7-ed20-4f37-a2e4-36a206e4453e req-c5bf3166-645b-4b7c-acf3-19ea9d7dc879 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received unexpected event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac for instance with vm_state building and task_state spawning.
Aug 16 12:25:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-2972d5b0-805e-4f0d-98a4-967425c6bafb req-e5dbb15a-f34e-4d97-b310-32655bad8501 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2972d5b0-805e-4f0d-98a4-967425c6bafb req-e5dbb15a-f34e-4d97-b310-32655bad8501 service nova] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2972d5b0-805e-4f0d-98a4-967425c6bafb req-e5dbb15a-f34e-4d97-b310-32655bad8501 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2972d5b0-805e-4f0d-98a4-967425c6bafb req-e5dbb15a-f34e-4d97-b310-32655bad8501 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-2972d5b0-805e-4f0d-98a4-967425c6bafb req-e5dbb15a-f34e-4d97-b310-32655bad8501 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] No waiting events found dispatching network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:25:35 user nova-compute[73520]: WARNING nova.compute.manager [req-2972d5b0-805e-4f0d-98a4-967425c6bafb req-e5dbb15a-f34e-4d97-b310-32655bad8501 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received unexpected event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac for instance with vm_state building and task_state spawning.
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188735.4949074, 27659935-6eb3-4cea-9648-f5820cddda98 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:25:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] VM Resumed (Lifecycle Event)
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:25:35 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Instance spawned successfully.
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:25:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188735.4951615, 27659935-6eb3-4cea-9648-f5820cddda98 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:25:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] VM Started (Lifecycle Event)
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:25:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:25:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 16 12:25:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:25:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Took 7.45 seconds to build instance.
Aug 16 12:25:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c68ff9e3-3347-4c0d-bb0a-db70287f2f69 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "27659935-6eb3-4cea-9648-f5820cddda98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.557s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:25:35 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:25:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:25:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:25:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:25:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:25:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:39 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:25:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:25:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:44 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:25:44 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7214MB free_disk=25.353496551513672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 91e479f7-5fc0-46d2-9c02-52175084fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance e0c2b937-066a-490f-a2a2-57ae3dfe814b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance fa037e15-3751-4088-9607-e2bb2a8d4f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 927fcd07-08e3-43ba-a6c2-730e0c557311 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 61633714-d25e-4cde-b757-b3c3f6fd8d71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 27659935-6eb3-4cea-9648-f5820cddda98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:25:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:25:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:25:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:25:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:25:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:25:45 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:25:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Updating instance_info_cache with network_info: [{"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:25:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:25:46 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:25:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:25:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UvhlbTck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:25:50 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:25:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:25:50 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:25:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:25:50 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe60e0e9-688a-4d95-a2d7-55323d5a6a4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:25:50 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d469a24a-704b-480f-8da4-a1243ef000c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b] added
Aug 16 12:25:50 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00ab1a4-094a-4f2c-a6cd-2e7d59ef1c5d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabe2670-9fbf-4296-a3e5-7bfe11e80c7d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UvhlbTck {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UvhlbTck" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bcd08f-0a28-475b-a7ee-ce994de4d8c1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UvhlbTck'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[506d0c6c-7eec-4894-bfb7-da8c0a9f4d6d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2063663-e5d4-45d2-89a6-90ad9689697d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:25:50 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:25:50 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:25:50 user nova-compute[73520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)
Aug 16 12:25:50 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:25:50 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:25:50 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:25:50 user nova-compute[73520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)
Aug 16 12:25:50 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:25:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --login" returned: 0 in 1.074s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a15c93-4345-4a04-a639-ae896a7fa551]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b, portal: 172.16.0.220,3260]
Aug 16 12:25:51 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b, portal: 172.16.0.220,3260] successful.
Aug 16 12:25:51 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b00b54-5a44-4290-8452-101565e24907]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d21e5b9-c0a3-43ec-950c-1652f3c90f60]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:25:51 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:25:51 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:25:51 user nova-compute[73520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)
Aug 16 12:25:51 user nova-compute[73520]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b (non-flash)
Aug 16 12:25:51 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:25:51 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:25:51 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:25:51 user nova-compute[73520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)
Aug 16 12:25:51 user nova-compute[73520]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b (non-flash)
Aug 16 12:25:51 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.354s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dab134a-a4ac-42e5-a29c-7607dfa7a2c4]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:25:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UvhlbTck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:25:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.398s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:25:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] <== connect_volume: return (2400ms) {'type': 'block', 'scsi_wwn': '23232373139663230', 'path': '/dev/sde'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:25:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232373139663230', 'path': '/dev/sde'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:25:52 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'flavor' on Instance uuid fa037e15-3751-4088-9607-e2bb2a8d4f01 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:25:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:25:53 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:25:53 user nova-compute[73520]:   <source dev="/dev/sde"/>
Aug 16 12:25:53 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:25:53 user nova-compute[73520]:   <serial>84a8d25a-e766-4cee-b417-b3032a0d391b</serial>
Aug 16 12:25:53 user nova-compute[73520]: </disk>
Aug 16 12:25:53 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:25:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:25:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:25:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] No VIF found with MAC fa:16:3e:e2:0e:27, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:25:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9f6bbcde-8392-41cd-9f74-f461c8144792 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.587s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:25:55 user nova-compute[73520]: INFO nova.compute.manager [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Detaching volume 84a8d25a-e766-4cee-b417-b3032a0d391b
Aug 16 12:25:55 user nova-compute[73520]: INFO nova.virt.block_device [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Attempting to driver detach volume 84a8d25a-e766-4cee-b417-b3032a0d391b from mountpoint /dev/vdb
Aug 16 12:25:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Attempting to detach device vdb from instance fa037e15-3751-4088-9607-e2bb2a8d4f01 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:25:55 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:25:55 user nova-compute[73520]:   <source dev="/dev/sde"/>
Aug 16 12:25:55 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:25:55 user nova-compute[73520]:   <serial>84a8d25a-e766-4cee-b417-b3032a0d391b</serial>
Aug 16 12:25:55 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:25:55 user nova-compute[73520]: </disk>
Aug 16 12:25:55 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:25:55 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully detached device vdb from instance fa037e15-3751-4088-9607-e2bb2a8d4f01 from the persistent domain config.
Aug 16 12:25:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa037e15-3751-4088-9607-e2bb2a8d4f01 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:25:55 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:25:55 user nova-compute[73520]:   <source dev="/dev/sde"/>
Aug 16 12:25:55 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:25:55 user nova-compute[73520]:   <serial>84a8d25a-e766-4cee-b417-b3032a0d391b</serial>
Aug 16 12:25:55 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:25:55 user nova-compute[73520]: </disk>
Aug 16 12:25:55 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692188755.6397548, fa037e15-3751-4088-9607-e2bb2a8d4f01 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa037e15-3751-4088-9607-e2bb2a8d4f01 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:25:55 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully detached device vdb from instance fa037e15-3751-4088-9607-e2bb2a8d4f01 from the live domain config.
Aug 16 12:25:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UvhlbTck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:25:55 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ace92c-521b-40d5-a4b2-aa9189de76c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2971856e-ae84-4daf-ad82-3f56e0d979b4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:25:55 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:25:55 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:25:55 user nova-compute[73520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)
Aug 16 12:25:55 user nova-compute[73520]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b (non-flash)
Aug 16 12:25:55 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:25:55 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:25:55 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:25:55 user nova-compute[73520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)
Aug 16 12:25:55 user nova-compute[73520]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b (non-flash)
Aug 16 12:25:55 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c121870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b'): ({'sde'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Removing single pathed devices sde {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[585144fa-bcfd-42ad-9e3a-37904a94fd05]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf102eb-bf2b-4bbc-95bb-4851f0330979]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Flushing IO for device /dev/sde {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a570ef22-28f5-4296-b618-a3c3c4fb504c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[099e0f84-7d35-44d5-b39b-df2ad850465e]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4678faa-2ea3-4dd4-a22c-0c667d33471a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d33b375-63d3-4784-9b26-89ce01d3a1a4]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b, portal: 172.16.0.220,3260]
Aug 16 12:25:55 user nova-compute[73520]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b, portal: 172.16.0.220,3260] successful.
Aug 16 12:25:55 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a8d25a-e766-4cee-b417-b3032a0d391b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2600fd0-a3c8-4e88-ab2c-95ad28168cde]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] <== disconnect_volume: return (294ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:25:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:25:56 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'flavor' on Instance uuid fa037e15-3751-4088-9607-e2bb2a8d4f01 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:25:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9c5185a3-fb56-454a-b5a4-7533120fff1d tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.815s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:25:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:25:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-fb993de8-5bd7-4ec8-b4bb-b57d1781c95e req-bd12b036-254d-4f66-9e08-4832d751b1fb service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received event network-changed-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-fb993de8-5bd7-4ec8-b4bb-b57d1781c95e req-bd12b036-254d-4f66-9e08-4832d751b1fb service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Refreshing instance network info cache due to event network-changed-f3809be6-2f1f-4594-b632-829bfd841717. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:26:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-fb993de8-5bd7-4ec8-b4bb-b57d1781c95e req-bd12b036-254d-4f66-9e08-4832d751b1fb service nova] Acquiring lock "refresh_cache-927fcd07-08e3-43ba-a6c2-730e0c557311" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:26:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-fb993de8-5bd7-4ec8-b4bb-b57d1781c95e req-bd12b036-254d-4f66-9e08-4832d751b1fb service nova] Acquired lock "refresh_cache-927fcd07-08e3-43ba-a6c2-730e0c557311" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:26:10 user nova-compute[73520]: DEBUG nova.network.neutron [req-fb993de8-5bd7-4ec8-b4bb-b57d1781c95e req-bd12b036-254d-4f66-9e08-4832d751b1fb service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Refreshing network info cache for port f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:26:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "927fcd07-08e3-43ba-a6c2-730e0c557311" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:11 user nova-compute[73520]: INFO nova.compute.manager [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Terminating instance
Aug 16 12:26:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:26:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-fb993de8-5bd7-4ec8-b4bb-b57d1781c95e req-bd12b036-254d-4f66-9e08-4832d751b1fb service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Updated VIF entry in instance network info cache for port f3809be6-2f1f-4594-b632-829bfd841717. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:26:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-fb993de8-5bd7-4ec8-b4bb-b57d1781c95e req-bd12b036-254d-4f66-9e08-4832d751b1fb service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Updating instance_info_cache with network_info: [{"id": "f3809be6-2f1f-4594-b632-829bfd841717", "address": "fa:16:3e:34:60:18", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3809be6-2f", "ovs_interfaceid": "f3809be6-2f1f-4594-b632-829bfd841717", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:26:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-fb993de8-5bd7-4ec8-b4bb-b57d1781c95e req-bd12b036-254d-4f66-9e08-4832d751b1fb service nova] Releasing lock "refresh_cache-927fcd07-08e3-43ba-a6c2-730e0c557311" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:26:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-77831200-80b2-4391-8c1e-c4fa3e66127a req-f2167cc4-abf3-462c-a697-38ccf44699ab service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received event network-vif-unplugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-77831200-80b2-4391-8c1e-c4fa3e66127a req-f2167cc4-abf3-462c-a697-38ccf44699ab service nova] Acquiring lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-77831200-80b2-4391-8c1e-c4fa3e66127a req-f2167cc4-abf3-462c-a697-38ccf44699ab service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-77831200-80b2-4391-8c1e-c4fa3e66127a req-f2167cc4-abf3-462c-a697-38ccf44699ab service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-77831200-80b2-4391-8c1e-c4fa3e66127a req-f2167cc4-abf3-462c-a697-38ccf44699ab service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] No waiting events found dispatching network-vif-unplugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-77831200-80b2-4391-8c1e-c4fa3e66127a req-f2167cc4-abf3-462c-a697-38ccf44699ab service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received event network-vif-unplugged-f3809be6-2f1f-4594-b632-829bfd841717 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:12 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Instance destroyed successfully.
Aug 16 12:26:12 user nova-compute[73520]: DEBUG nova.objects.instance [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lazy-loading 'resources' on Instance uuid 927fcd07-08e3-43ba-a6c2-730e0c557311 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2071021142',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2071021142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2071021142',id=31,image_ref='b82d7e0f-c15f-4b39-a594-99d3a8b209c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwl0zvuTr+QiKDY3EixulPRdlKIpZGrCEUc8qtl0EDEYrRF08XEGRkINK38At/JrX1qv7U3w19f1em5xoyDbvhq/MXbSuWHuU87OKITzzlXoglty207E2Ql9z7TRKCNig==',key_name='tempest-keypair-1136591830',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:24:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-x8m0b9k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-496055159',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ed1823b0de433ab523470e235fdd72',uuid=927fcd07-08e3-43ba-a6c2-730e0c557311,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3809be6-2f1f-4594-b632-829bfd841717", "address": "fa:16:3e:34:60:18", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3809be6-2f", "ovs_interfaceid": "f3809be6-2f1f-4594-b632-829bfd841717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "f3809be6-2f1f-4594-b632-829bfd841717", "address": "fa:16:3e:34:60:18", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3809be6-2f", "ovs_interfaceid": "f3809be6-2f1f-4594-b632-829bfd841717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:60:18,bridge_name='br-int',has_traffic_filtering=True,id=f3809be6-2f1f-4594-b632-829bfd841717,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3809be6-2f') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_vif [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:60:18,bridge_name='br-int',has_traffic_filtering=True,id=f3809be6-2f1f-4594-b632-829bfd841717,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3809be6-2f') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3809be6-2f, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:26:12 user nova-compute[73520]: INFO os_vif [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:60:18,bridge_name='br-int',has_traffic_filtering=True,id=f3809be6-2f1f-4594-b632-829bfd841717,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3809be6-2f')
Aug 16 12:26:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OeLfZlAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:26:12 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[784a1161-9bb6-4899-99c3-63d492dac269]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c867d7-6544-40ce-8ca6-a48caade6806]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:26:12 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:26:12 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:26:12 user nova-compute[73520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)
Aug 16 12:26:12 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:26:12 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:26:12 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:26:12 user nova-compute[73520]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 (non-flash)
Aug 16 12:26:12 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c6913f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289'): ({'sdd'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Removing single pathed devices sdd {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eb2a9f-a924-4a46-8dc0-427e4b74853f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.037s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26f51f3-8d9b-4dbe-9940-f782d18545f0]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flushing IO for device /dev/sdd {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d502f9-4721-4955-8c15-f313776544f0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7186e9b-d89c-4596-8341-ca3ed0147777]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] SCSI volumes sdd have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ad316b4a', '/dev/disk/by-id/scsi-23662353030656431', '/dev/disk/by-id/scsi-1SCST_BIOad316b4a-6b500ed19e82de4d') {{(pid=84372) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 12:26:12 user nova-compute[73520]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_ad316b4a
Aug 16 12:26:12 user nova-compute[73520]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23662353030656431
Aug 16 12:26:12 user nova-compute[73520]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOad316b4a-6b500ed19e82de4d
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f026913e-41b9-475d-b1c7-2c1720e8236c]: (4, None) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff2fd9f-6abd-4f2d-972d-084bb2958169]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb86f41-ef14-44fb-b29a-3c163fbdcf12]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289, portal: 172.16.0.220,3260]
Aug 16 12:26:12 user nova-compute[73520]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289, portal: 172.16.0.220,3260] successful.
Aug 16 12:26:12 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dfa341-8c9d-4355-9a32-8ff6f86d1289 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa553d3-7795-4d12-8772-a3efd46857c7]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== disconnect_volume: return (360ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:26:12 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Deleting instance files /opt/stack/data/nova/instances/927fcd07-08e3-43ba-a6c2-730e0c557311_del
Aug 16 12:26:12 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Deletion of /opt/stack/data/nova/instances/927fcd07-08e3-43ba-a6c2-730e0c557311_del complete
Aug 16 12:26:12 user nova-compute[73520]: INFO nova.compute.manager [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 16 12:26:12 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:26:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-1ab30bcb-a60a-4efe-abf0-d23a85f3d20f req-a9669256-2e69-417c-8868-f222f0bf18c3 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Received event network-changed-ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-1ab30bcb-a60a-4efe-abf0-d23a85f3d20f req-a9669256-2e69-417c-8868-f222f0bf18c3 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Refreshing instance network info cache due to event network-changed-ec555ffc-ecb2-48d7-8c11-d07a3238df5a. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:26:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1ab30bcb-a60a-4efe-abf0-d23a85f3d20f req-a9669256-2e69-417c-8868-f222f0bf18c3 service nova] Acquiring lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:26:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1ab30bcb-a60a-4efe-abf0-d23a85f3d20f req-a9669256-2e69-417c-8868-f222f0bf18c3 service nova] Acquired lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:26:13 user nova-compute[73520]: DEBUG nova.network.neutron [req-1ab30bcb-a60a-4efe-abf0-d23a85f3d20f req-a9669256-2e69-417c-8868-f222f0bf18c3 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Refreshing network info cache for port ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received event network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] Acquiring lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] No waiting events found dispatching network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:14 user nova-compute[73520]: WARNING nova.compute.manager [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received unexpected event network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 for instance with vm_state active and task_state deleting.
Aug 16 12:26:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received event network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] Acquiring lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] No waiting events found dispatching network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:14 user nova-compute[73520]: WARNING nova.compute.manager [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received unexpected event network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 for instance with vm_state active and task_state deleting.
Aug 16 12:26:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received event network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] Acquiring lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] No waiting events found dispatching network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:14 user nova-compute[73520]: WARNING nova.compute.manager [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received unexpected event network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 for instance with vm_state active and task_state deleting.
Aug 16 12:26:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received event network-vif-unplugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] Acquiring lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] No waiting events found dispatching network-vif-unplugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-beb8e025-5eba-4568-a19b-39b4b72abf32 req-a15121dc-de75-4654-a8a3-4565735a55cf service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received event network-vif-unplugged-f3809be6-2f1f-4594-b632-829bfd841717 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-1ab30bcb-a60a-4efe-abf0-d23a85f3d20f req-a9669256-2e69-417c-8868-f222f0bf18c3 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updated VIF entry in instance network info cache for port ec555ffc-ecb2-48d7-8c11-d07a3238df5a. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-1ab30bcb-a60a-4efe-abf0-d23a85f3d20f req-a9669256-2e69-417c-8868-f222f0bf18c3 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updating instance_info_cache with network_info: [{"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1ab30bcb-a60a-4efe-abf0-d23a85f3d20f req-a9669256-2e69-417c-8868-f222f0bf18c3 service nova] Releasing lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:26:14 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:26:14 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Took 2.11 seconds to deallocate network for instance.
Aug 16 12:26:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-9810f885-1e6b-4e02-a842-dbe68db0f124 req-9b82cec7-5247-436b-b50e-7cfebca9f969 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received event network-changed-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-9810f885-1e6b-4e02-a842-dbe68db0f124 req-9b82cec7-5247-436b-b50e-7cfebca9f969 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Refreshing instance network info cache due to event network-changed-9a58f602-1dd8-46b4-8cc6-f5ef41b44750. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:26:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9810f885-1e6b-4e02-a842-dbe68db0f124 req-9b82cec7-5247-436b-b50e-7cfebca9f969 service nova] Acquiring lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:26:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9810f885-1e6b-4e02-a842-dbe68db0f124 req-9b82cec7-5247-436b-b50e-7cfebca9f969 service nova] Acquired lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:26:15 user nova-compute[73520]: DEBUG nova.network.neutron [req-9810f885-1e6b-4e02-a842-dbe68db0f124 req-9b82cec7-5247-436b-b50e-7cfebca9f969 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Refreshing network info cache for port 9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:26:15 user nova-compute[73520]: INFO nova.compute.manager [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Took 1.07 seconds to detach 1 volumes for instance.
Aug 16 12:26:15 user nova-compute[73520]: DEBUG nova.compute.manager [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Deleting volume: 64dfa341-8c9d-4355-9a32-8ff6f86d1289 {{(pid=73520) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG nova.network.neutron [req-9810f885-1e6b-4e02-a842-dbe68db0f124 req-9b82cec7-5247-436b-b50e-7cfebca9f969 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updated VIF entry in instance network info cache for port 9a58f602-1dd8-46b4-8cc6-f5ef41b44750. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG nova.network.neutron [req-9810f885-1e6b-4e02-a842-dbe68db0f124 req-9b82cec7-5247-436b-b50e-7cfebca9f969 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updating instance_info_cache with network_info: [{"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-ee9bb6d1-dd6f-454f-ba6c-ac4a9e6d59d6 req-86a88b1b-7d8a-4d58-8d58-a5dc7ca78dea service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received event network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ee9bb6d1-dd6f-454f-ba6c-ac4a9e6d59d6 req-86a88b1b-7d8a-4d58-8d58-a5dc7ca78dea service nova] Acquiring lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ee9bb6d1-dd6f-454f-ba6c-ac4a9e6d59d6 req-86a88b1b-7d8a-4d58-8d58-a5dc7ca78dea service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ee9bb6d1-dd6f-454f-ba6c-ac4a9e6d59d6 req-86a88b1b-7d8a-4d58-8d58-a5dc7ca78dea service nova] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-ee9bb6d1-dd6f-454f-ba6c-ac4a9e6d59d6 req-86a88b1b-7d8a-4d58-8d58-a5dc7ca78dea service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] No waiting events found dispatching network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:16 user nova-compute[73520]: WARNING nova.compute.manager [req-ee9bb6d1-dd6f-454f-ba6c-ac4a9e6d59d6 req-86a88b1b-7d8a-4d58-8d58-a5dc7ca78dea service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received unexpected event network-vif-plugged-f3809be6-2f1f-4594-b632-829bfd841717 for instance with vm_state deleted and task_state None.
Aug 16 12:26:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-ee9bb6d1-dd6f-454f-ba6c-ac4a9e6d59d6 req-86a88b1b-7d8a-4d58-8d58-a5dc7ca78dea service nova] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Received event network-vif-deleted-f3809be6-2f1f-4594-b632-829bfd841717 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9810f885-1e6b-4e02-a842-dbe68db0f124 req-9b82cec7-5247-436b-b50e-7cfebca9f969 service nova] Releasing lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Stashing vm_state: active {{(pid=73520) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.494s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:16 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Deleted allocations for instance 927fcd07-08e3-43ba-a6c2-730e0c557311
Aug 16 12:26:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG nova.objects.instance [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'pci_requests' on Instance uuid 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:26:16 user nova-compute[73520]: INFO nova.compute.claims [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Claim successful on node user
Aug 16 12:26:16 user nova-compute[73520]: DEBUG nova.objects.instance [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'resources' on Instance uuid 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0d3d8fc4-ce37-4ba6-ab0a-6d03c8375d59 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "927fcd07-08e3-43ba-a6c2-730e0c557311" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.251s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:16 user nova-compute[73520]: DEBUG nova.objects.instance [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:16 user nova-compute[73520]: INFO nova.compute.resource_tracker [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updating resource usage from migration cd971c95-3720-4147-88e4-4a253a14ea65
Aug 16 12:26:17 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:26:17 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:26:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.559s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:17 user nova-compute[73520]: INFO nova.compute.manager [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Migrating
Aug 16 12:26:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:26:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:26:17 user nova-compute[73520]: INFO nova.compute.rpcapi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 16 12:26:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:26:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:26:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquired lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:26:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:26:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updating instance_info_cache with network_info: [{"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:26:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Releasing lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:26:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Starting migrate_disk_and_power_off {{(pid=73520) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 12:26:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-5e028fed-e567-402b-80be-dadd550aba20 req-c90864f4-35fc-48de-bc3a-2bb985fe7c80 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received event network-vif-unplugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5e028fed-e567-402b-80be-dadd550aba20 req-c90864f4-35fc-48de-bc3a-2bb985fe7c80 service nova] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5e028fed-e567-402b-80be-dadd550aba20 req-c90864f4-35fc-48de-bc3a-2bb985fe7c80 service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5e028fed-e567-402b-80be-dadd550aba20 req-c90864f4-35fc-48de-bc3a-2bb985fe7c80 service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-5e028fed-e567-402b-80be-dadd550aba20 req-c90864f4-35fc-48de-bc3a-2bb985fe7c80 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] No waiting events found dispatching network-vif-unplugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:18 user nova-compute[73520]: WARNING nova.compute.manager [req-5e028fed-e567-402b-80be-dadd550aba20 req-c90864f4-35fc-48de-bc3a-2bb985fe7c80 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received unexpected event network-vif-unplugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 for instance with vm_state active and task_state resize_migrating.
Aug 16 12:26:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-5e028fed-e567-402b-80be-dadd550aba20 req-c90864f4-35fc-48de-bc3a-2bb985fe7c80 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received event network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5e028fed-e567-402b-80be-dadd550aba20 req-c90864f4-35fc-48de-bc3a-2bb985fe7c80 service nova] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5e028fed-e567-402b-80be-dadd550aba20 req-c90864f4-35fc-48de-bc3a-2bb985fe7c80 service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5e028fed-e567-402b-80be-dadd550aba20 req-c90864f4-35fc-48de-bc3a-2bb985fe7c80 service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-5e028fed-e567-402b-80be-dadd550aba20 req-c90864f4-35fc-48de-bc3a-2bb985fe7c80 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] No waiting events found dispatching network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:18 user nova-compute[73520]: WARNING nova.compute.manager [req-5e028fed-e567-402b-80be-dadd550aba20 req-c90864f4-35fc-48de-bc3a-2bb985fe7c80 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received unexpected event network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 for instance with vm_state active and task_state resize_migrating.
Aug 16 12:26:18 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Instance destroyed successfully.
Aug 16 12:26:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-399250487',display_name='tempest-ServerActionsTestOtherA-server-399250487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-399250487',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl3ev6edzI1KLHo1Y5B96ptBm6NSqIbcBOFcMZceXonYnWR3AckvFat7GQrt1EQ+8fQAGMP/p7GDPbXyfJwBrIOn5y+eKTCEQMF2Y9CFOeelDTAPhe+VbqGs9Aw6sueMA==',key_name='tempest-keypair-2118649879',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:24:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-mvskp7wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:26:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=8c32e02c-2cca-46b4-a8e1-0eb854c4cb39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2094819446-network", "vif_mac": "fa:16:3e:20:ac:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2094819446-network", "vif_mac": "fa:16:3e:20:ac:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_vif [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a58f602-1d, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:18 user nova-compute[73520]: INFO os_vif [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d')
Aug 16 12:26:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saNpvoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:26:18 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e520a9-be48-4f55-b3c6-b60e591be62c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[50057c1f-5b9a-4d0b-b464-89bbbe96d62b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:26:18 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:26:18 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:26:18 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:26:18 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:26:18 user nova-compute[73520]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:26:18 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c5dfac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4140ff56-7c0b-46ee-9a07-7ad2a687bdbf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa960dc-8c79-42ff-af43-983f2d708c64]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b02b36-394e-40b7-a68a-df7cb07e8f43]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55b3452-87bf-4d73-9542-1c2288fad91d]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_876c3330', '/dev/disk/by-id/scsi-1SCST_BIO876c3330-0b7a1f391968720c', '/dev/disk/by-id/scsi-23062376131663339') {{(pid=84372) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[074b5432-d516-4a4c-835c-4a091eeab416]: (4, None) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[78353e77-c5e5-43e3-ab8b-d595f3fe4524]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d45e24-9d4f-40f1-92c3-ee8128ff0b0a]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260]
Aug 16 12:26:18 user nova-compute[73520]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260] successful.
Aug 16 12:26:18 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2b29c6-ec02-40cc-8afa-2af409e477e0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] <== disconnect_volume: return (314ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:26:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:26:19 user nova-compute[73520]: INFO nova.compute.manager [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Rescuing
Aug 16 12:26:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:26:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquired lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:26:19 user nova-compute[73520]: DEBUG nova.network.neutron [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:26:19 user nova-compute[73520]: DEBUG nova.network.neutron [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Port 9a58f602-1dd8-46b4-8cc6-f5ef41b44750 binding to destination host user is already ACTIVE {{(pid=73520) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquired lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Updating instance_info_cache with network_info: [{"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Releasing lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updating instance_info_cache with network_info: [{"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Releasing lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-41848ad4-ba4d-4dba-9d04-182c2273ad85 req-bdfcf9d8-9dca-4988-8c26-65c39fbf413e service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-unplugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-41848ad4-ba4d-4dba-9d04-182c2273ad85 req-bdfcf9d8-9dca-4988-8c26-65c39fbf413e service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-41848ad4-ba4d-4dba-9d04-182c2273ad85 req-bdfcf9d8-9dca-4988-8c26-65c39fbf413e service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-41848ad4-ba4d-4dba-9d04-182c2273ad85 req-bdfcf9d8-9dca-4988-8c26-65c39fbf413e service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-41848ad4-ba4d-4dba-9d04-182c2273ad85 req-bdfcf9d8-9dca-4988-8c26-65c39fbf413e service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-unplugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:20 user nova-compute[73520]: WARNING nova.compute.manager [req-41848ad4-ba4d-4dba-9d04-182c2273ad85 req-bdfcf9d8-9dca-4988-8c26-65c39fbf413e service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-unplugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state active and task_state rescuing.
Aug 16 12:26:20 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Instance destroyed successfully.
Aug 16 12:26:20 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Attempting rescue
Aug 16 12:26:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73520) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Instance directory exists: not creating {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 12:26:20 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Creating image(s)
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "/opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "/opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG nova.objects.instance [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6ed1c5ac-d727-4157-a294-55b49ed26eea {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG os_brick.utils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dc2a20-5ed6-4da6-a6c6-9b1b67e0b487]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4686a04-4e96-43f6-9180-9d0091ce73a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bf681b-1a4d-4a35-856f-6c3bc8be6fa6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8ddf8f-aed0-4f14-9202-1ff300e75ff1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:26:21 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8254f2d-dce6-4062-ace7-ea7e41a5ba85]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG os_brick.utils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.rescue {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.rescue" returned: 0 in 0.057s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.objects.instance [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'migration_context' on Instance uuid 6ed1c5ac-d727-4157-a294-55b49ed26eea {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Start _get_guest_xml network_info=[{"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "vif_mac": "fa:16:3e:98:9d:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.objects.instance [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'resources' on Instance uuid 6ed1c5ac-d727-4157-a294-55b49ed26eea {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.objects.instance [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'numa_topology' on Instance uuid 6ed1c5ac-d727-4157-a294-55b49ed26eea {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:21 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:26:21 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.objects.instance [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ed1c5ac-d727-4157-a294-55b49ed26eea {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-725496249',display_name='tempest-ServerRescueNegativeTestJSON-server-725496249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-725496249',id=25,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:21:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930fb7964e2942c88c3416be172c6884',ramdisk_id='',reservation_id='r-9dpq0ryk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-863509458',owner_user_name='tempest-ServerRescueNegativeTestJSON-863509458-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:21:45Z,user_data=None,user_id='0d351d0adad3463ebb2e6917a5f91920',uuid=6ed1c5ac-d727-4157-a294-55b49ed26eea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "vif_mac": "fa:16:3e:98:9d:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converting VIF {"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "vif_mac": "fa:16:3e:98:9d:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=b381ef78-e52f-4f08-a65e-c3b33ac5b5a2,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381ef78-e5') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.objects.instance [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ed1c5ac-d727-4157-a294-55b49ed26eea {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:26:21 user nova-compute[73520]:   <uuid>6ed1c5ac-d727-4157-a294-55b49ed26eea</uuid>
Aug 16 12:26:21 user nova-compute[73520]:   <name>instance-00000019</name>
Aug 16 12:26:21 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:26:21 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:26:21 user nova-compute[73520]:   <metadata>
Aug 16 12:26:21 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:26:21 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:26:21 user nova-compute[73520]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-725496249</nova:name>
Aug 16 12:26:21 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:26:21</nova:creationTime>
Aug 16 12:26:21 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:26:21 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:26:21 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:26:21 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:26:21 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:26:21 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:26:21 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:26:21 user nova-compute[73520]:       <nova:owner>
Aug 16 12:26:21 user nova-compute[73520]:         <nova:user uuid="0d351d0adad3463ebb2e6917a5f91920">tempest-ServerRescueNegativeTestJSON-863509458-project-member</nova:user>
Aug 16 12:26:21 user nova-compute[73520]:         <nova:project uuid="930fb7964e2942c88c3416be172c6884">tempest-ServerRescueNegativeTestJSON-863509458</nova:project>
Aug 16 12:26:21 user nova-compute[73520]:       </nova:owner>
Aug 16 12:26:21 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:26:21 user nova-compute[73520]:       <nova:ports>
Aug 16 12:26:21 user nova-compute[73520]:         <nova:port uuid="b381ef78-e52f-4f08-a65e-c3b33ac5b5a2">
Aug 16 12:26:21 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 12:26:21 user nova-compute[73520]:         </nova:port>
Aug 16 12:26:21 user nova-compute[73520]:       </nova:ports>
Aug 16 12:26:21 user nova-compute[73520]:     </nova:instance>
Aug 16 12:26:21 user nova-compute[73520]:   </metadata>
Aug 16 12:26:21 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:26:21 user nova-compute[73520]:     <system>
Aug 16 12:26:21 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:26:21 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:26:21 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:26:21 user nova-compute[73520]:       <entry name="serial">6ed1c5ac-d727-4157-a294-55b49ed26eea</entry>
Aug 16 12:26:21 user nova-compute[73520]:       <entry name="uuid">6ed1c5ac-d727-4157-a294-55b49ed26eea</entry>
Aug 16 12:26:21 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:26:21 user nova-compute[73520]:     </system>
Aug 16 12:26:21 user nova-compute[73520]:   </sysinfo>
Aug 16 12:26:21 user nova-compute[73520]:   <os>
Aug 16 12:26:21 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:26:21 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:26:21 user nova-compute[73520]:   </os>
Aug 16 12:26:21 user nova-compute[73520]:   <features>
Aug 16 12:26:21 user nova-compute[73520]:     <acpi/>
Aug 16 12:26:21 user nova-compute[73520]:     <apic/>
Aug 16 12:26:21 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:26:21 user nova-compute[73520]:   </features>
Aug 16 12:26:21 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:26:21 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:26:21 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:26:21 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:26:21 user nova-compute[73520]:   </clock>
Aug 16 12:26:21 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:26:21 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:26:21 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:26:21 user nova-compute[73520]:   </cpu>
Aug 16 12:26:21 user nova-compute[73520]:   <devices>
Aug 16 12:26:21 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:26:21 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:26:21 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.rescue"/>
Aug 16 12:26:21 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:26:21 user nova-compute[73520]:     </disk>
Aug 16 12:26:21 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:26:21 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:26:21 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk"/>
Aug 16 12:26:21 user nova-compute[73520]:       <target dev="vdb" bus="virtio"/>
Aug 16 12:26:21 user nova-compute[73520]:     </disk>
Aug 16 12:26:21 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:26:21 user nova-compute[73520]:       <mac address="fa:16:3e:98:9d:d6"/>
Aug 16 12:26:21 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:26:21 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:26:21 user nova-compute[73520]:       <target dev="tapb381ef78-e5"/>
Aug 16 12:26:21 user nova-compute[73520]:     </interface>
Aug 16 12:26:21 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:26:21 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/console.log" append="off"/>
Aug 16 12:26:21 user nova-compute[73520]:     </serial>
Aug 16 12:26:21 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:26:21 user nova-compute[73520]:     <video>
Aug 16 12:26:21 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:26:21 user nova-compute[73520]:     </video>
Aug 16 12:26:21 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:26:21 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:26:21 user nova-compute[73520]:     </rng>
Aug 16 12:26:21 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:26:21 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:26:21 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:26:21 user nova-compute[73520]:     </memballoon>
Aug 16 12:26:21 user nova-compute[73520]:   </devices>
Aug 16 12:26:21 user nova-compute[73520]: </domain>
Aug 16 12:26:21 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:26:21 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Instance destroyed successfully.
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:26:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No VIF found with MAC fa:16:3e:98:9d:d6, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:26:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-673ada8b-65de-449c-bf33-fe993a9cf592 req-6e72f801-19a0-41b8-b12b-456452e254cf service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-673ada8b-65de-449c-bf33-fe993a9cf592 req-6e72f801-19a0-41b8-b12b-456452e254cf service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-673ada8b-65de-449c-bf33-fe993a9cf592 req-6e72f801-19a0-41b8-b12b-456452e254cf service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-673ada8b-65de-449c-bf33-fe993a9cf592 req-6e72f801-19a0-41b8-b12b-456452e254cf service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-673ada8b-65de-449c-bf33-fe993a9cf592 req-6e72f801-19a0-41b8-b12b-456452e254cf service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:22 user nova-compute[73520]: WARNING nova.compute.manager [req-673ada8b-65de-449c-bf33-fe993a9cf592 req-6e72f801-19a0-41b8-b12b-456452e254cf service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state active and task_state rescuing.
Aug 16 12:26:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-760f5ad7-e757-4eaa-a6b2-4e03897636fa req-6e2a77f1-4efa-441b-a854-b08d1c201fc2 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-760f5ad7-e757-4eaa-a6b2-4e03897636fa req-6e2a77f1-4efa-441b-a854-b08d1c201fc2 service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-760f5ad7-e757-4eaa-a6b2-4e03897636fa req-6e2a77f1-4efa-441b-a854-b08d1c201fc2 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-760f5ad7-e757-4eaa-a6b2-4e03897636fa req-6e2a77f1-4efa-441b-a854-b08d1c201fc2 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-760f5ad7-e757-4eaa-a6b2-4e03897636fa req-6e2a77f1-4efa-441b-a854-b08d1c201fc2 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:24 user nova-compute[73520]: WARNING nova.compute.manager [req-760f5ad7-e757-4eaa-a6b2-4e03897636fa req-6e2a77f1-4efa-441b-a854-b08d1c201fc2 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state active and task_state rescuing.
Aug 16 12:26:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-760f5ad7-e757-4eaa-a6b2-4e03897636fa req-6e2a77f1-4efa-441b-a854-b08d1c201fc2 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-760f5ad7-e757-4eaa-a6b2-4e03897636fa req-6e2a77f1-4efa-441b-a854-b08d1c201fc2 service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-760f5ad7-e757-4eaa-a6b2-4e03897636fa req-6e2a77f1-4efa-441b-a854-b08d1c201fc2 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-760f5ad7-e757-4eaa-a6b2-4e03897636fa req-6e2a77f1-4efa-441b-a854-b08d1c201fc2 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-760f5ad7-e757-4eaa-a6b2-4e03897636fa req-6e2a77f1-4efa-441b-a854-b08d1c201fc2 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:24 user nova-compute[73520]: WARNING nova.compute.manager [req-760f5ad7-e757-4eaa-a6b2-4e03897636fa req-6e2a77f1-4efa-441b-a854-b08d1c201fc2 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state active and task_state rescuing.
Aug 16 12:26:24 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Removed pending event for 6ed1c5ac-d727-4157-a294-55b49ed26eea due to event {{(pid=73520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 12:26:24 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188784.9962957, 6ed1c5ac-d727-4157-a294-55b49ed26eea => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:26:24 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] VM Resumed (Lifecycle Event)
Aug 16 12:26:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-e1fc5637-0807-4c10-a7cb-bd86f4aaf1a0 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:26:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:26:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:26:25 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 12:26:25 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188785.00074, 6ed1c5ac-d727-4157-a294-55b49ed26eea => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:26:25 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] VM Started (Lifecycle Event)
Aug 16 12:26:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:26:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:26:27 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188772.1704795, 927fcd07-08e3-43ba-a6c2-730e0c557311 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:26:27 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] VM Stopped (Lifecycle Event)
Aug 16 12:26:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f5c60d81-6763-46b6-89a4-c96cc90ef000 None None] [instance: 927fcd07-08e3-43ba-a6c2-730e0c557311] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:26:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Starting finish_migration {{(pid=73520) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Instance directory exists: not creating {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 12:26:31 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Creating image(s)
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Ensure instance console log exists: /opt/stack/data/nova/instances/8c32e02c-2cca-46b4-a8e1-0eb854c4cb39/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Start _get_guest_xml network_info=[{"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2094819446-network", "vif_mac": "fa:16:3e:20:ac:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saNpvoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8c32e02c-2cca-46b4-a8e1-0eb854c4cb39', 'attached_at': '2023-08-16T12:26:31.000000', 'detached_at': '', 'volume_id': 'e370c4ce-2c3d-495a-a7c3-f138777b2f20', 'serial': 'e370c4ce-2c3d-495a-a7c3-f138777b2f20'}, 'attachment_id': 'a01d33ef-bf0b-4e88-9bd3-1abbd9bfae11', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:26:31 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:26:31 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.objects.instance [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saNpvoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:26:31 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:26:31 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:26:31 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9335fda9-0bd1-44d3-9f1f-67336c073452]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:26:31 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc94d2a-5efa-4891-83ef-35b228ff0262]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20] added
Aug 16 12:26:31 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[073eafb1-c03e-47bc-b6a4-93179043a3dd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc7fab3-5fcc-4b09-9072-21edeed004b3]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saNpvoES {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saNpvoES" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa12be4-a821-445a-944d-75103bb1925a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'saNpvoES'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9287d5e7-8a63-4863-8480-e794aec45971]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd701d8-bb2a-45a1-8b3b-5e6a6934bb4e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:26:31 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:26:31 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:26:31 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:26:31 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[70815d53-c4f9-4c04-bef1-bbc28452b872]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260]
Aug 16 12:26:31 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260] successful.
Aug 16 12:26:31 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a849e832-d354-40a8-acc6-240d3494dc7f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c98e930-8f4e-4a72-afb4-d6bde633cb83]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:26:31 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:26:31 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:26:31 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:26:31 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:26:31 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:26:31 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94db6dc-e026-4bc7-9f19-347a0eb4f6f0]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:26:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saNpvoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23062376131663339', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062376131663339', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-399250487',display_name='tempest-ServerActionsTestOtherA-server-399250487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-399250487',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl3ev6edzI1KLHo1Y5B96ptBm6NSqIbcBOFcMZceXonYnWR3AckvFat7GQrt1EQ+8fQAGMP/p7GDPbXyfJwBrIOn5y+eKTCEQMF2Y9CFOeelDTAPhe+VbqGs9Aw6sueMA==',key_name='tempest-keypair-2118649879',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:24:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-mvskp7wz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=8c32e02c-2cca-46b4-a8e1-0eb854c4cb39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2094819446-network", "vif_mac": "fa:16:3e:20:ac:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2094819446-network", "vif_mac": "fa:16:3e:20:ac:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:26:32 user nova-compute[73520]:   <uuid>8c32e02c-2cca-46b4-a8e1-0eb854c4cb39</uuid>
Aug 16 12:26:32 user nova-compute[73520]:   <name>instance-00000020</name>
Aug 16 12:26:32 user nova-compute[73520]:   <memory>2097152</memory>
Aug 16 12:26:32 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:26:32 user nova-compute[73520]:   <metadata>
Aug 16 12:26:32 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:26:32 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:26:32 user nova-compute[73520]:       <nova:name>tempest-ServerActionsTestOtherA-server-399250487</nova:name>
Aug 16 12:26:32 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:26:31</nova:creationTime>
Aug 16 12:26:32 user nova-compute[73520]:       <nova:flavor name="m1.small">
Aug 16 12:26:32 user nova-compute[73520]:         <nova:memory>2048</nova:memory>
Aug 16 12:26:32 user nova-compute[73520]:         <nova:disk>20</nova:disk>
Aug 16 12:26:32 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:26:32 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:26:32 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:26:32 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:26:32 user nova-compute[73520]:       <nova:owner>
Aug 16 12:26:32 user nova-compute[73520]:         <nova:user uuid="d2495e37a99546deb000789aac42ed34">tempest-ServerActionsTestOtherA-294187005-project-member</nova:user>
Aug 16 12:26:32 user nova-compute[73520]:         <nova:project uuid="57dd566104a645fd8abda43da8d9b980">tempest-ServerActionsTestOtherA-294187005</nova:project>
Aug 16 12:26:32 user nova-compute[73520]:       </nova:owner>
Aug 16 12:26:32 user nova-compute[73520]:       <nova:ports>
Aug 16 12:26:32 user nova-compute[73520]:         <nova:port uuid="9a58f602-1dd8-46b4-8cc6-f5ef41b44750">
Aug 16 12:26:32 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 12:26:32 user nova-compute[73520]:         </nova:port>
Aug 16 12:26:32 user nova-compute[73520]:       </nova:ports>
Aug 16 12:26:32 user nova-compute[73520]:     </nova:instance>
Aug 16 12:26:32 user nova-compute[73520]:   </metadata>
Aug 16 12:26:32 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:26:32 user nova-compute[73520]:     <system>
Aug 16 12:26:32 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:26:32 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:26:32 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:26:32 user nova-compute[73520]:       <entry name="serial">8c32e02c-2cca-46b4-a8e1-0eb854c4cb39</entry>
Aug 16 12:26:32 user nova-compute[73520]:       <entry name="uuid">8c32e02c-2cca-46b4-a8e1-0eb854c4cb39</entry>
Aug 16 12:26:32 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:26:32 user nova-compute[73520]:     </system>
Aug 16 12:26:32 user nova-compute[73520]:   </sysinfo>
Aug 16 12:26:32 user nova-compute[73520]:   <os>
Aug 16 12:26:32 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:26:32 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:26:32 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:26:32 user nova-compute[73520]:   </os>
Aug 16 12:26:32 user nova-compute[73520]:   <features>
Aug 16 12:26:32 user nova-compute[73520]:     <acpi/>
Aug 16 12:26:32 user nova-compute[73520]:     <apic/>
Aug 16 12:26:32 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:26:32 user nova-compute[73520]:   </features>
Aug 16 12:26:32 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:26:32 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:26:32 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:26:32 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:26:32 user nova-compute[73520]:   </clock>
Aug 16 12:26:32 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:26:32 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:26:32 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:26:32 user nova-compute[73520]:   </cpu>
Aug 16 12:26:32 user nova-compute[73520]:   <devices>
Aug 16 12:26:32 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:26:32 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:26:32 user nova-compute[73520]:       <source dev="/dev/sdb"/>
Aug 16 12:26:32 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:26:32 user nova-compute[73520]:       <serial>e370c4ce-2c3d-495a-a7c3-f138777b2f20</serial>
Aug 16 12:26:32 user nova-compute[73520]:     </disk>
Aug 16 12:26:32 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:26:32 user nova-compute[73520]:       <mac address="fa:16:3e:20:ac:77"/>
Aug 16 12:26:32 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:26:32 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:26:32 user nova-compute[73520]:       <target dev="tap9a58f602-1d"/>
Aug 16 12:26:32 user nova-compute[73520]:     </interface>
Aug 16 12:26:32 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:26:32 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/8c32e02c-2cca-46b4-a8e1-0eb854c4cb39/console.log" append="off"/>
Aug 16 12:26:32 user nova-compute[73520]:     </serial>
Aug 16 12:26:32 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:26:32 user nova-compute[73520]:     <video>
Aug 16 12:26:32 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:26:32 user nova-compute[73520]:     </video>
Aug 16 12:26:32 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:26:32 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:26:32 user nova-compute[73520]:     </rng>
Aug 16 12:26:32 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:26:32 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:26:32 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:26:32 user nova-compute[73520]:     </memballoon>
Aug 16 12:26:32 user nova-compute[73520]:   </devices>
Aug 16 12:26:32 user nova-compute[73520]: </domain>
Aug 16 12:26:32 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-399250487',display_name='tempest-ServerActionsTestOtherA-server-399250487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-399250487',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl3ev6edzI1KLHo1Y5B96ptBm6NSqIbcBOFcMZceXonYnWR3AckvFat7GQrt1EQ+8fQAGMP/p7GDPbXyfJwBrIOn5y+eKTCEQMF2Y9CFOeelDTAPhe+VbqGs9Aw6sueMA==',key_name='tempest-keypair-2118649879',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:24:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-mvskp7wz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=8c32e02c-2cca-46b4-a8e1-0eb854c4cb39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2094819446-network", "vif_mac": "fa:16:3e:20:ac:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2094819446-network", "vif_mac": "fa:16:3e:20:ac:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG os_vif [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a58f602-1d, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a58f602-1d, col_values=(('external_ids', {'iface-id': '9a58f602-1dd8-46b4-8cc6-f5ef41b44750', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:ac:77', 'vm-uuid': '8c32e02c-2cca-46b4-a8e1-0eb854c4cb39'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:26:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:32 user nova-compute[73520]: INFO os_vif [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d')
Aug 16 12:26:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:26:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] No VIF found with MAC fa:16:3e:20:ac:77, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:26:33 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188778.6115384, 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:26:33 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] VM Stopped (Lifecycle Event)
Aug 16 12:26:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-29fd2143-b8c7-435d-bbe7-0890a5974d20 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:26:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:34 user nova-compute[73520]: DEBUG nova.compute.manager [req-687347e4-8832-4ea8-954c-45417c67c6b6 req-4e82a659-eb3d-44bd-a44a-2d3f9cb86e12 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received event network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-687347e4-8832-4ea8-954c-45417c67c6b6 req-4e82a659-eb3d-44bd-a44a-2d3f9cb86e12 service nova] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-687347e4-8832-4ea8-954c-45417c67c6b6 req-4e82a659-eb3d-44bd-a44a-2d3f9cb86e12 service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-687347e4-8832-4ea8-954c-45417c67c6b6 req-4e82a659-eb3d-44bd-a44a-2d3f9cb86e12 service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:34 user nova-compute[73520]: DEBUG nova.compute.manager [req-687347e4-8832-4ea8-954c-45417c67c6b6 req-4e82a659-eb3d-44bd-a44a-2d3f9cb86e12 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] No waiting events found dispatching network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:34 user nova-compute[73520]: WARNING nova.compute.manager [req-687347e4-8832-4ea8-954c-45417c67c6b6 req-4e82a659-eb3d-44bd-a44a-2d3f9cb86e12 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received unexpected event network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 for instance with vm_state active and task_state resize_finish.
Aug 16 12:26:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:36 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188796.340264, 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:26:36 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] VM Resumed (Lifecycle Event)
Aug 16 12:26:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:26:36 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Instance running successfully.
Aug 16 12:26:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Failed to set time: agent not configured {{(pid=73520) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 12:26:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-55e69d2d-030d-4ca2-95c0-65415eee3600 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] finish_migration finished successfully. {{(pid=73520) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 12:26:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:26:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:26:36 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 12:26:36 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188796.3434281, 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:26:36 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] VM Started (Lifecycle Event)
Aug 16 12:26:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:26:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:26:36 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 12:26:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-cfa0f012-96fb-4db3-886b-65117c042363 req-d58f7d46-68a1-44a2-8db5-b7d693a05edc service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received event network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cfa0f012-96fb-4db3-886b-65117c042363 req-d58f7d46-68a1-44a2-8db5-b7d693a05edc service nova] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cfa0f012-96fb-4db3-886b-65117c042363 req-d58f7d46-68a1-44a2-8db5-b7d693a05edc service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cfa0f012-96fb-4db3-886b-65117c042363 req-d58f7d46-68a1-44a2-8db5-b7d693a05edc service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-cfa0f012-96fb-4db3-886b-65117c042363 req-d58f7d46-68a1-44a2-8db5-b7d693a05edc service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] No waiting events found dispatching network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:36 user nova-compute[73520]: WARNING nova.compute.manager [req-cfa0f012-96fb-4db3-886b-65117c042363 req-d58f7d46-68a1-44a2-8db5-b7d693a05edc service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received unexpected event network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 for instance with vm_state resized and task_state None.
Aug 16 12:26:36 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:26:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:26:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:26:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:26:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-e17687b4-7c69-4074-a498-7a73c4d1e64a req-9d0b1fb4-e6bf-439f-951e-349e2da8395b service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received event network-changed-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-e17687b4-7c69-4074-a498-7a73c4d1e64a req-9d0b1fb4-e6bf-439f-951e-349e2da8395b service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Refreshing instance network info cache due to event network-changed-e230cf5f-ff43-476e-b808-41f0c3f11963. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e17687b4-7c69-4074-a498-7a73c4d1e64a req-9d0b1fb4-e6bf-439f-951e-349e2da8395b service nova] Acquiring lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e17687b4-7c69-4074-a498-7a73c4d1e64a req-9d0b1fb4-e6bf-439f-951e-349e2da8395b service nova] Acquired lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG nova.network.neutron [req-e17687b4-7c69-4074-a498-7a73c4d1e64a req-9d0b1fb4-e6bf-439f-951e-349e2da8395b service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Refreshing network info cache for port e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG nova.network.neutron [req-e17687b4-7c69-4074-a498-7a73c4d1e64a req-9d0b1fb4-e6bf-439f-951e-349e2da8395b service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Updated VIF entry in instance network info cache for port e230cf5f-ff43-476e-b808-41f0c3f11963. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG nova.network.neutron [req-e17687b4-7c69-4074-a498-7a73c4d1e64a req-9d0b1fb4-e6bf-439f-951e-349e2da8395b service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Updating instance_info_cache with network_info: [{"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e17687b4-7c69-4074-a498-7a73c4d1e64a req-9d0b1fb4-e6bf-439f-951e-349e2da8395b service nova] Releasing lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:39 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:26:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:26:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:26:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:26:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:44 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:26:44 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7420MB free_disk=25.313289642333984GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Applying migration context for instance 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 as it has an incoming, in-progress migration cd971c95-3720-4147-88e4-4a253a14ea65. Migration status is finished {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 12:26:44 user nova-compute[73520]: INFO nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updating resource usage from migration cd971c95-3720-4147-88e4-4a253a14ea65
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 91e479f7-5fc0-46d2-9c02-52175084fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance e0c2b937-066a-490f-a2a2-57ae3dfe814b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance fa037e15-3751-4088-9607-e2bb2a8d4f01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 61633714-d25e-4cde-b757-b3c3f6fd8d71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 27659935-6eb3-4cea-9648-f5820cddda98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Migration cd971c95-3720-4147-88e4-4a253a14ea65 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:26:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:45 user nova-compute[73520]: INFO nova.compute.manager [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Shelving
Aug 16 12:26:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:45 user nova-compute[73520]: INFO nova.compute.manager [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Terminating instance
Aug 16 12:26:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-e3317b47-4afa-4d34-a993-69cf9e87977a req-ec74bda9-da17-4da3-bc6c-c8408a0d1884 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received event network-vif-unplugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e3317b47-4afa-4d34-a993-69cf9e87977a req-ec74bda9-da17-4da3-bc6c-c8408a0d1884 service nova] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e3317b47-4afa-4d34-a993-69cf9e87977a req-ec74bda9-da17-4da3-bc6c-c8408a0d1884 service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e3317b47-4afa-4d34-a993-69cf9e87977a req-ec74bda9-da17-4da3-bc6c-c8408a0d1884 service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG nova.compute.manager [req-e3317b47-4afa-4d34-a993-69cf9e87977a req-ec74bda9-da17-4da3-bc6c-c8408a0d1884 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] No waiting events found dispatching network-vif-unplugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:45 user nova-compute[73520]: WARNING nova.compute.manager [req-e3317b47-4afa-4d34-a993-69cf9e87977a req-ec74bda9-da17-4da3-bc6c-c8408a0d1884 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received unexpected event network-vif-unplugged-e230cf5f-ff43-476e-b808-41f0c3f11963 for instance with vm_state active and task_state shelving.
Aug 16 12:26:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:45 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Instance destroyed successfully.
Aug 16 12:26:45 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Beginning cold snapshot process
Aug 16 12:26:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:26:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk /opt/stack/data/nova/instances/snapshots/tmp2pdachph/158d5796ef7540bca5084feacb3925b0 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-91e479f7-5fc0-46d2-9c02-52175084fbf6" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-91e479f7-5fc0-46d2-9c02-52175084fbf6" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:26:46 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Instance destroyed successfully.
Aug 16 12:26:46 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lazy-loading 'resources' on Instance uuid fa037e15-3751-4088-9607-e2bb2a8d4f01 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-636699223',display_name='tempest-AttachVolumeNegativeTest-server-636699223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-636699223',id=30,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRiLsytlAHoKZ5G9/35XcNKwvzBN5jWSHX3ECXJRwb8AIT7XiRliYsxSaxvY/llkP8MElmGAWbI4fMFGmzNrMNGlXOLRVcFPQoiU8/zdD4a/EM3tJHHQX9bhT65nJ7I2Q==',key_name='tempest-keypair-1606534571',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1059841e2ee04ca4870497a1ec60bcaa',ramdisk_id='',reservation_id='r-w3vkfhm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1618912538',owner_user_name='tempest-AttachVolumeNegativeTest-1618912538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6426c917725745038fdb1d03fec4a2fd',uuid=fa037e15-3751-4088-9607-e2bb2a8d4f01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd32a4f5-3408-4338-ac44-3253c58f650a", "address": "fa:16:3e:e2:0e:27", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32a4f5-34", "ovs_interfaceid": "fd32a4f5-3408-4338-ac44-3253c58f650a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converting VIF {"id": "fd32a4f5-3408-4338-ac44-3253c58f650a", "address": "fa:16:3e:e2:0e:27", "network": {"id": "53e7b78b-6a3e-438f-b27c-54d30f822d56", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1166811742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1059841e2ee04ca4870497a1ec60bcaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32a4f5-34", "ovs_interfaceid": "fd32a4f5-3408-4338-ac44-3253c58f650a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=fd32a4f5-3408-4338-ac44-3253c58f650a,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32a4f5-34') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG os_vif [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=fd32a4f5-3408-4338-ac44-3253c58f650a,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32a4f5-34') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd32a4f5-34, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:46 user nova-compute[73520]: INFO os_vif [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=fd32a4f5-3408-4338-ac44-3253c58f650a,network=Network(53e7b78b-6a3e-438f-b27c-54d30f822d56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32a4f5-34')
Aug 16 12:26:46 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Deleting instance files /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01_del
Aug 16 12:26:46 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Deletion of /opt/stack/data/nova/instances/fa037e15-3751-4088-9607-e2bb2a8d4f01_del complete
Aug 16 12:26:46 user nova-compute[73520]: INFO nova.compute.manager [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 16 12:26:46 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Updating instance_info_cache with network_info: [{"id": "2905850b-ae11-4b8f-9f36-8843981fc748", "address": "fa:16:3e:e5:45:a0", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2905850b-ae", "ovs_interfaceid": "2905850b-ae11-4b8f-9f36-8843981fc748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-91e479f7-5fc0-46d2-9c02-52175084fbf6" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:26:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk /opt/stack/data/nova/instances/snapshots/tmp2pdachph/158d5796ef7540bca5084feacb3925b0" returned: 0 in 0.861s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:26:46 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Snapshot extracted, beginning image upload
Aug 16 12:26:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received event network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] No waiting events found dispatching network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:47 user nova-compute[73520]: WARNING nova.compute.manager [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received unexpected event network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 12:26:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Received event network-vif-unplugged-fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] Acquiring lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] No waiting events found dispatching network-vif-unplugged-fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Received event network-vif-unplugged-fd32a4f5-3408-4338-ac44-3253c58f650a for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Received event network-vif-plugged-fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] Acquiring lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] No waiting events found dispatching network-vif-plugged-fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:26:47 user nova-compute[73520]: WARNING nova.compute.manager [req-b763c5b9-393b-4f44-ab47-67678d02393e req-0f94e98d-013c-4f30-aac8-32cb0fe4804b service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Received unexpected event network-vif-plugged-fd32a4f5-3408-4338-ac44-3253c58f650a for instance with vm_state active and task_state deleting.
Aug 16 12:26:47 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:26:47 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Took 1.23 seconds to deallocate network for instance.
Aug 16 12:26:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:48 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:26:48 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:26:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.555s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:48 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Deleted allocations for instance fa037e15-3751-4088-9607-e2bb2a8d4f01
Aug 16 12:26:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f2e79e81-cb29-4aae-85d7-a723c805e122 tempest-AttachVolumeNegativeTest-1618912538 tempest-AttachVolumeNegativeTest-1618912538-project-member] Lock "fa037e15-3751-4088-9607-e2bb2a8d4f01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.011s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:49 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Snapshot image upload complete
Aug 16 12:26:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:26:49 user nova-compute[73520]: INFO nova.compute.manager [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Shelve offloading
Aug 16 12:26:49 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Instance destroyed successfully.
Aug 16 12:26:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:26:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:26:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquired lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:26:49 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:26:49 user nova-compute[73520]: DEBUG nova.compute.manager [req-2c4e0d96-0b16-4297-9742-149baa93a1a6 req-0d928dc3-33db-467c-93ac-5b0f63c934be service nova] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Received event network-vif-deleted-fd32a4f5-3408-4338-ac44-3253c58f650a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:26:50 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Updating instance_info_cache with network_info: [{"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:26:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Releasing lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:26:50 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Instance destroyed successfully.
Aug 16 12:26:50 user nova-compute[73520]: DEBUG nova.objects.instance [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'resources' on Instance uuid 61633714-d25e-4cde-b757-b3c3f6fd8d71 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1180361508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1180361508',id=33,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfkEYZLGDx6EYezKN4oK9B9wCW5phyLrCizSqon9tcojC71hDzlZRPIPlCl3qnE+Uq7R7KhXw33/MHXWNmk8GveZToBVft7dR+WRJyJmNOWzjTlp/G3pP44YVDI8bKFtg==',key_name='tempest-keypair-1175824880',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ed29e455a840474b8a1407af538883ab',ramdisk_id='',reservation_id='r-70vxdm7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-974908846',owner_user_name='tempest-AttachVolumeShelveTestJSON-974908846-project-member',shelved_at='2023-08-16T12:26:49.519730',shelved_host='user',shelved_image_id='ca1deef4-63cd-427b-8f95-7631563ac419'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:26:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7e48ee408e24af083b40b19437cfbac',uuid=61633714-d25e-4cde-b757-b3c3f6fd8d71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:26:50 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converting VIF {"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:26:50 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:26:50 user nova-compute[73520]: DEBUG os_vif [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:26:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape230cf5f-ff, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:26:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:26:50 user nova-compute[73520]: INFO os_vif [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff')
Aug 16 12:26:50 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Deleting instance files /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71_del
Aug 16 12:26:50 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Deletion of /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71_del complete
Aug 16 12:26:51 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Deleted allocations for instance 61633714-d25e-4cde-b757-b3c3f6fd8d71
Aug 16 12:26:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:26:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:26:51 user nova-compute[73520]: DEBUG nova.objects.instance [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'numa_topology' on Instance uuid 61633714-d25e-4cde-b757-b3c3f6fd8d71 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:26:51 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:26:51 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:26:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2ccfda31-819d-4e7c-a347-de2f9787c702 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.450s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:26:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:26:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:00 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188805.7424657, 61633714-d25e-4cde-b757-b3c3f6fd8d71 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:27:00 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] VM Stopped (Lifecycle Event)
Aug 16 12:27:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f9deec06-a0b7-4e2a-b06d-65eb5fce9268 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:27:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:01 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188806.2180657, fa037e15-3751-4088-9607-e2bb2a8d4f01 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:27:01 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] VM Stopped (Lifecycle Event)
Aug 16 12:27:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-009ecded-29ea-44d1-a87f-b42b0a794a7c None None] [instance: fa037e15-3751-4088-9607-e2bb2a8d4f01] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:27:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:07 user nova-compute[73520]: INFO nova.compute.manager [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Terminating instance
Aug 16 12:27:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-65dd16f8-2ca7-4aa3-bd7a-82dd81bc47da req-cc0d9ad9-244f-446c-b303-a988fa7286ae service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Received event network-vif-unplugged-27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-65dd16f8-2ca7-4aa3-bd7a-82dd81bc47da req-cc0d9ad9-244f-446c-b303-a988fa7286ae service nova] Acquiring lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-65dd16f8-2ca7-4aa3-bd7a-82dd81bc47da req-cc0d9ad9-244f-446c-b303-a988fa7286ae service nova] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-65dd16f8-2ca7-4aa3-bd7a-82dd81bc47da req-cc0d9ad9-244f-446c-b303-a988fa7286ae service nova] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-65dd16f8-2ca7-4aa3-bd7a-82dd81bc47da req-cc0d9ad9-244f-446c-b303-a988fa7286ae service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] No waiting events found dispatching network-vif-unplugged-27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:27:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-65dd16f8-2ca7-4aa3-bd7a-82dd81bc47da req-cc0d9ad9-244f-446c-b303-a988fa7286ae service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Received event network-vif-unplugged-27d75b6f-6479-4d50-9c9e-f0dc8800b660 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:27:08 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Instance destroyed successfully.
Aug 16 12:27:08 user nova-compute[73520]: DEBUG nova.objects.instance [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lazy-loading 'resources' on Instance uuid e0c2b937-066a-490f-a2a2-57ae3dfe814b {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1596224209',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1596224209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1596224209',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNx+AhdqigGLgUGXGkWJz6SuhZ8eHje8bxVk+mxSZiRI72VYrb8ZQ/h21nZd/H1syRq0NFiONgN7tgleOltqn7Jhw3aKtW8zwxNq9jOb/OFRVKCnSTOrHT/ODHuMLXWTpA==',key_name='tempest-keypair-1304610420',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:22:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-44ozn0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:22:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17ed1823b0de433ab523470e235fdd72',uuid=e0c2b937-066a-490f-a2a2-57ae3dfe814b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "address": "fa:16:3e:b6:90:a6", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d75b6f-64", "ovs_interfaceid": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "address": "fa:16:3e:b6:90:a6", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d75b6f-64", "ovs_interfaceid": "27d75b6f-6479-4d50-9c9e-f0dc8800b660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:90:a6,bridge_name='br-int',has_traffic_filtering=True,id=27d75b6f-6479-4d50-9c9e-f0dc8800b660,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d75b6f-64') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_vif [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:90:a6,bridge_name='br-int',has_traffic_filtering=True,id=27d75b6f-6479-4d50-9c9e-f0dc8800b660,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d75b6f-64') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27d75b6f-64, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:27:08 user nova-compute[73520]: INFO os_vif [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:90:a6,bridge_name='br-int',has_traffic_filtering=True,id=27d75b6f-6479-4d50-9c9e-f0dc8800b660,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d75b6f-64')
Aug 16 12:27:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoJChYEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:27:08 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fa8c9f-3967-44e9-8aee-a693ef14d617]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2368e2eb-f184-4806-b09f-6ae917a26f5f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:27:08 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:27:08 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:27:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:27:08 user nova-compute[73520]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 (non-flash)
Aug 16 12:27:08 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:27:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c5ddfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3'): ({'sdf'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Removing single pathed devices sdf {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[52728761-4e53-46c9-a741-9e9f496339a1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb7aef3-e5bd-44ac-9bc0-c6bac011c97f]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flushing IO for device /dev/sdf {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[900440e8-b53d-4fe5-8ab2-92e5d52063a1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cc370a-9df8-4d11-9143-6ef4ef4c3c04]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] SCSI volumes sdf have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd646bda1-de4c7020759d28de', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d646bda1', '/dev/disk/by-id/scsi-26465346337303230') {{(pid=84372) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b383f01-d230-4541-b1f9-1182c4c6cdef]: (4, None) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce9761b-f808-4cf3-a57b-77f87c7389a9]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e156fd-e331-4bfd-8367-93555841daf8]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3, portal: 172.16.0.220,3260]
Aug 16 12:27:08 user nova-compute[73520]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3, portal: 172.16.0.220,3260] successful.
Aug 16 12:27:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7018bd3-2899-481b-8ae4-e08c034c8cd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb82d1f-f80c-4c93-8a73-532a0e106e7d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== disconnect_volume: return (278ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:27:08 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Deleting instance files /opt/stack/data/nova/instances/e0c2b937-066a-490f-a2a2-57ae3dfe814b_del
Aug 16 12:27:08 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Deletion of /opt/stack/data/nova/instances/e0c2b937-066a-490f-a2a2-57ae3dfe814b_del complete
Aug 16 12:27:08 user nova-compute[73520]: INFO nova.compute.manager [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 16 12:27:08 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:27:08 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:27:09 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:27:09 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Took 0.99 seconds to deallocate network for instance.
Aug 16 12:27:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-199b4032-0c4f-4849-a5db-fc913d9b8846 req-52bbc92d-cf7f-4ac9-8b26-e085b3d08ee9 service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Received event network-vif-deleted-27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:27:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-482b2076-a853-41aa-bc3e-7b516cd6b3fc req-9579aa7d-a011-476c-8039-b463c6fd7b99 service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Received event network-vif-plugged-27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:27:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-482b2076-a853-41aa-bc3e-7b516cd6b3fc req-9579aa7d-a011-476c-8039-b463c6fd7b99 service nova] Acquiring lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-482b2076-a853-41aa-bc3e-7b516cd6b3fc req-9579aa7d-a011-476c-8039-b463c6fd7b99 service nova] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-482b2076-a853-41aa-bc3e-7b516cd6b3fc req-9579aa7d-a011-476c-8039-b463c6fd7b99 service nova] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-482b2076-a853-41aa-bc3e-7b516cd6b3fc req-9579aa7d-a011-476c-8039-b463c6fd7b99 service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] No waiting events found dispatching network-vif-plugged-27d75b6f-6479-4d50-9c9e-f0dc8800b660 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:27:09 user nova-compute[73520]: WARNING nova.compute.manager [req-482b2076-a853-41aa-bc3e-7b516cd6b3fc req-9579aa7d-a011-476c-8039-b463c6fd7b99 service nova] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Received unexpected event network-vif-plugged-27d75b6f-6479-4d50-9c9e-f0dc8800b660 for instance with vm_state active and task_state deleting.
Aug 16 12:27:10 user nova-compute[73520]: INFO nova.compute.manager [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Took 0.75 seconds to detach 1 volumes for instance.
Aug 16 12:27:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Deleting volume: e7018bd3-2899-481b-8ae4-e08c034c8cd3 {{(pid=73520) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 12:27:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:10 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:27:10 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:27:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:10 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Deleted allocations for instance e0c2b937-066a-490f-a2a2-57ae3dfe814b
Aug 16 12:27:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5ca9e9e7-62ce-43d7-b96c-b8243b355ac9 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "e0c2b937-066a-490f-a2a2-57ae3dfe814b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.557s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "d712e605-8ee2-4bd5-adce-61d0f284c835" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:27:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:27:13 user nova-compute[73520]: INFO nova.compute.claims [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Claim successful on node user
Aug 16 12:27:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:27:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:27:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG nova.policy [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d1e9417253f43b482e8ee5b3109a697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3756b80f2243dca0b31ffea7438b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:27:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Creating image(s)
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "/opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "/opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "/opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.196s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.225s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk 1073741824" returned: 0 in 0.054s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Successfully created port: 131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.192s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Cannot resize image /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'migration_context' on Instance uuid d712e605-8ee2-4bd5-adce-61d0f284c835 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Ensure instance console log exists: /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Successfully updated port: 131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "refresh_cache-d712e605-8ee2-4bd5-adce-61d0f284c835" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquired lock "refresh_cache-d712e605-8ee2-4bd5-adce-61d0f284c835" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-7469c1f4-5455-422b-a7c3-69dee4c4bf8d req-cf21c99b-9ceb-4ef2-beae-c84d7b007ee3 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received event network-changed-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-7469c1f4-5455-422b-a7c3-69dee4c4bf8d req-cf21c99b-9ceb-4ef2-beae-c84d7b007ee3 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Refreshing instance network info cache due to event network-changed-131d0164-5b2f-4e74-96c4-36ff11809851. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:27:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7469c1f4-5455-422b-a7c3-69dee4c4bf8d req-cf21c99b-9ceb-4ef2-beae-c84d7b007ee3 service nova] Acquiring lock "refresh_cache-d712e605-8ee2-4bd5-adce-61d0f284c835" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Updating instance_info_cache with network_info: [{"id": "131d0164-5b2f-4e74-96c4-36ff11809851", "address": "fa:16:3e:57:9f:46", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d0164-5b", "ovs_interfaceid": "131d0164-5b2f-4e74-96c4-36ff11809851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Releasing lock "refresh_cache-d712e605-8ee2-4bd5-adce-61d0f284c835" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Instance network_info: |[{"id": "131d0164-5b2f-4e74-96c4-36ff11809851", "address": "fa:16:3e:57:9f:46", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d0164-5b", "ovs_interfaceid": "131d0164-5b2f-4e74-96c4-36ff11809851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7469c1f4-5455-422b-a7c3-69dee4c4bf8d req-cf21c99b-9ceb-4ef2-beae-c84d7b007ee3 service nova] Acquired lock "refresh_cache-d712e605-8ee2-4bd5-adce-61d0f284c835" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.network.neutron [req-7469c1f4-5455-422b-a7c3-69dee4c4bf8d req-cf21c99b-9ceb-4ef2-beae-c84d7b007ee3 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Refreshing network info cache for port 131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Start _get_guest_xml network_info=[{"id": "131d0164-5b2f-4e74-96c4-36ff11809851", "address": "fa:16:3e:57:9f:46", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d0164-5b", "ovs_interfaceid": "131d0164-5b2f-4e74-96c4-36ff11809851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:27:16 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:27:16 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:27:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-732553761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-732553761',id=35,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-bkorysu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:27:14Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=d712e605-8ee2-4bd5-adce-61d0f284c835,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "131d0164-5b2f-4e74-96c4-36ff11809851", "address": "fa:16:3e:57:9f:46", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d0164-5b", "ovs_interfaceid": "131d0164-5b2f-4e74-96c4-36ff11809851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "131d0164-5b2f-4e74-96c4-36ff11809851", "address": "fa:16:3e:57:9f:46", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d0164-5b", "ovs_interfaceid": "131d0164-5b2f-4e74-96c4-36ff11809851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:9f:46,bridge_name='br-int',has_traffic_filtering=True,id=131d0164-5b2f-4e74-96c4-36ff11809851,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d0164-5b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'pci_devices' on Instance uuid d712e605-8ee2-4bd5-adce-61d0f284c835 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:27:16 user nova-compute[73520]:   <uuid>d712e605-8ee2-4bd5-adce-61d0f284c835</uuid>
Aug 16 12:27:16 user nova-compute[73520]:   <name>instance-00000023</name>
Aug 16 12:27:16 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:27:16 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:27:16 user nova-compute[73520]:   <metadata>
Aug 16 12:27:16 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:27:16 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:27:16 user nova-compute[73520]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-732553761</nova:name>
Aug 16 12:27:16 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:27:16</nova:creationTime>
Aug 16 12:27:16 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:27:16 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:27:16 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:27:16 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:27:16 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:27:16 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:27:16 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:27:16 user nova-compute[73520]:       <nova:owner>
Aug 16 12:27:16 user nova-compute[73520]:         <nova:user uuid="3d1e9417253f43b482e8ee5b3109a697">tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member</nova:user>
Aug 16 12:27:16 user nova-compute[73520]:         <nova:project uuid="4d3756b80f2243dca0b31ffea7438b5d">tempest-ServerBootFromVolumeStableRescueTest-1104312883</nova:project>
Aug 16 12:27:16 user nova-compute[73520]:       </nova:owner>
Aug 16 12:27:16 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:27:16 user nova-compute[73520]:       <nova:ports>
Aug 16 12:27:16 user nova-compute[73520]:         <nova:port uuid="131d0164-5b2f-4e74-96c4-36ff11809851">
Aug 16 12:27:16 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 12:27:16 user nova-compute[73520]:         </nova:port>
Aug 16 12:27:16 user nova-compute[73520]:       </nova:ports>
Aug 16 12:27:16 user nova-compute[73520]:     </nova:instance>
Aug 16 12:27:16 user nova-compute[73520]:   </metadata>
Aug 16 12:27:16 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:27:16 user nova-compute[73520]:     <system>
Aug 16 12:27:16 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:27:16 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:27:16 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:27:16 user nova-compute[73520]:       <entry name="serial">d712e605-8ee2-4bd5-adce-61d0f284c835</entry>
Aug 16 12:27:16 user nova-compute[73520]:       <entry name="uuid">d712e605-8ee2-4bd5-adce-61d0f284c835</entry>
Aug 16 12:27:16 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:27:16 user nova-compute[73520]:     </system>
Aug 16 12:27:16 user nova-compute[73520]:   </sysinfo>
Aug 16 12:27:16 user nova-compute[73520]:   <os>
Aug 16 12:27:16 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:27:16 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:27:16 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:27:16 user nova-compute[73520]:   </os>
Aug 16 12:27:16 user nova-compute[73520]:   <features>
Aug 16 12:27:16 user nova-compute[73520]:     <acpi/>
Aug 16 12:27:16 user nova-compute[73520]:     <apic/>
Aug 16 12:27:16 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:27:16 user nova-compute[73520]:   </features>
Aug 16 12:27:16 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:27:16 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:27:16 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:27:16 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:27:16 user nova-compute[73520]:   </clock>
Aug 16 12:27:16 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:27:16 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:27:16 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:27:16 user nova-compute[73520]:   </cpu>
Aug 16 12:27:16 user nova-compute[73520]:   <devices>
Aug 16 12:27:16 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:27:16 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:27:16 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk"/>
Aug 16 12:27:16 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:27:16 user nova-compute[73520]:     </disk>
Aug 16 12:27:16 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:27:16 user nova-compute[73520]:       <mac address="fa:16:3e:57:9f:46"/>
Aug 16 12:27:16 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:27:16 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:27:16 user nova-compute[73520]:       <target dev="tap131d0164-5b"/>
Aug 16 12:27:16 user nova-compute[73520]:     </interface>
Aug 16 12:27:16 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:27:16 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/console.log" append="off"/>
Aug 16 12:27:16 user nova-compute[73520]:     </serial>
Aug 16 12:27:16 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:27:16 user nova-compute[73520]:     <video>
Aug 16 12:27:16 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:27:16 user nova-compute[73520]:     </video>
Aug 16 12:27:16 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:27:16 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:27:16 user nova-compute[73520]:     </rng>
Aug 16 12:27:16 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:27:16 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:27:16 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:27:16 user nova-compute[73520]:     </memballoon>
Aug 16 12:27:16 user nova-compute[73520]:   </devices>
Aug 16 12:27:16 user nova-compute[73520]: </domain>
Aug 16 12:27:16 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:27:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-732553761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-732553761',id=35,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-bkorysu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:27:14Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=d712e605-8ee2-4bd5-adce-61d0f284c835,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "131d0164-5b2f-4e74-96c4-36ff11809851", "address": "fa:16:3e:57:9f:46", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d0164-5b", "ovs_interfaceid": "131d0164-5b2f-4e74-96c4-36ff11809851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "131d0164-5b2f-4e74-96c4-36ff11809851", "address": "fa:16:3e:57:9f:46", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d0164-5b", "ovs_interfaceid": "131d0164-5b2f-4e74-96c4-36ff11809851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:9f:46,bridge_name='br-int',has_traffic_filtering=True,id=131d0164-5b2f-4e74-96c4-36ff11809851,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d0164-5b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG os_vif [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9f:46,bridge_name='br-int',has_traffic_filtering=True,id=131d0164-5b2f-4e74-96c4-36ff11809851,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d0164-5b') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap131d0164-5b, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap131d0164-5b, col_values=(('external_ids', {'iface-id': '131d0164-5b2f-4e74-96c4-36ff11809851', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:9f:46', 'vm-uuid': 'd712e605-8ee2-4bd5-adce-61d0f284c835'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:16 user nova-compute[73520]: INFO os_vif [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9f:46,bridge_name='br-int',has_traffic_filtering=True,id=131d0164-5b2f-4e74-96c4-36ff11809851,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d0164-5b')
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No VIF found with MAC fa:16:3e:57:9f:46, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.network.neutron [req-7469c1f4-5455-422b-a7c3-69dee4c4bf8d req-cf21c99b-9ceb-4ef2-beae-c84d7b007ee3 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Updated VIF entry in instance network info cache for port 131d0164-5b2f-4e74-96c4-36ff11809851. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG nova.network.neutron [req-7469c1f4-5455-422b-a7c3-69dee4c4bf8d req-cf21c99b-9ceb-4ef2-beae-c84d7b007ee3 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Updating instance_info_cache with network_info: [{"id": "131d0164-5b2f-4e74-96c4-36ff11809851", "address": "fa:16:3e:57:9f:46", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d0164-5b", "ovs_interfaceid": "131d0164-5b2f-4e74-96c4-36ff11809851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:27:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7469c1f4-5455-422b-a7c3-69dee4c4bf8d req-cf21c99b-9ceb-4ef2-beae-c84d7b007ee3 service nova] Releasing lock "refresh_cache-d712e605-8ee2-4bd5-adce-61d0f284c835" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:27:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-55d8b003-1bed-4ae2-a65b-b632665198ab req-f10c7a3d-8894-4f82-be44-84d32a5d2079 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received event network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:27:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-55d8b003-1bed-4ae2-a65b-b632665198ab req-f10c7a3d-8894-4f82-be44-84d32a5d2079 service nova] Acquiring lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-55d8b003-1bed-4ae2-a65b-b632665198ab req-f10c7a3d-8894-4f82-be44-84d32a5d2079 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-55d8b003-1bed-4ae2-a65b-b632665198ab req-f10c7a3d-8894-4f82-be44-84d32a5d2079 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-55d8b003-1bed-4ae2-a65b-b632665198ab req-f10c7a3d-8894-4f82-be44-84d32a5d2079 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] No waiting events found dispatching network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:27:18 user nova-compute[73520]: WARNING nova.compute.manager [req-55d8b003-1bed-4ae2-a65b-b632665198ab req-f10c7a3d-8894-4f82-be44-84d32a5d2079 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received unexpected event network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 for instance with vm_state building and task_state spawning.
Aug 16 12:27:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-5aac4265-a74a-4fdc-aa00-16bbe8f9f01a req-ab627264-d69f-4bf3-9c73-fa60e125fdb7 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-changed-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:27:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-5aac4265-a74a-4fdc-aa00-16bbe8f9f01a req-ab627264-d69f-4bf3-9c73-fa60e125fdb7 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Refreshing instance network info cache due to event network-changed-8018c557-722c-41a7-91e0-f63bc6568bac. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:27:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5aac4265-a74a-4fdc-aa00-16bbe8f9f01a req-ab627264-d69f-4bf3-9c73-fa60e125fdb7 service nova] Acquiring lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:27:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5aac4265-a74a-4fdc-aa00-16bbe8f9f01a req-ab627264-d69f-4bf3-9c73-fa60e125fdb7 service nova] Acquired lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:27:19 user nova-compute[73520]: DEBUG nova.network.neutron [req-5aac4265-a74a-4fdc-aa00-16bbe8f9f01a req-ab627264-d69f-4bf3-9c73-fa60e125fdb7 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Refreshing network info cache for port 8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188840.0976338, d712e605-8ee2-4bd5-adce-61d0f284c835 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:27:20 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] VM Resumed (Lifecycle Event)
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:27:20 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Instance spawned successfully.
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:27:20 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188840.1018238, d712e605-8ee2-4bd5-adce-61d0f284c835 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:27:20 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] VM Started (Lifecycle Event)
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:27:20 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-5d5ab207-7911-43ab-8c01-19b710a8d2b3 req-33249693-d0a2-48b8-8d5b-9badc8e315d3 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received event network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5d5ab207-7911-43ab-8c01-19b710a8d2b3 req-33249693-d0a2-48b8-8d5b-9badc8e315d3 service nova] Acquiring lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5d5ab207-7911-43ab-8c01-19b710a8d2b3 req-33249693-d0a2-48b8-8d5b-9badc8e315d3 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5d5ab207-7911-43ab-8c01-19b710a8d2b3 req-33249693-d0a2-48b8-8d5b-9badc8e315d3 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-5d5ab207-7911-43ab-8c01-19b710a8d2b3 req-33249693-d0a2-48b8-8d5b-9badc8e315d3 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] No waiting events found dispatching network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:27:20 user nova-compute[73520]: WARNING nova.compute.manager [req-5d5ab207-7911-43ab-8c01-19b710a8d2b3 req-33249693-d0a2-48b8-8d5b-9badc8e315d3 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received unexpected event network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 for instance with vm_state building and task_state spawning.
Aug 16 12:27:20 user nova-compute[73520]: INFO nova.compute.manager [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Took 5.75 seconds to spawn the instance on the hypervisor.
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:27:20 user nova-compute[73520]: INFO nova.compute.manager [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Took 6.64 seconds to build instance.
Aug 16 12:27:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c9209b48-ddbd-4c3d-afdf-74adfe5d7850 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.755s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.network.neutron [req-5aac4265-a74a-4fdc-aa00-16bbe8f9f01a req-ab627264-d69f-4bf3-9c73-fa60e125fdb7 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updated VIF entry in instance network info cache for port 8018c557-722c-41a7-91e0-f63bc6568bac. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG nova.network.neutron [req-5aac4265-a74a-4fdc-aa00-16bbe8f9f01a req-ab627264-d69f-4bf3-9c73-fa60e125fdb7 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating instance_info_cache with network_info: [{"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:27:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5aac4265-a74a-4fdc-aa00-16bbe8f9f01a req-ab627264-d69f-4bf3-9c73-fa60e125fdb7 service nova] Releasing lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:27:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:22 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188827.9966462, e0c2b937-066a-490f-a2a2-57ae3dfe814b => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:27:22 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] VM Stopped (Lifecycle Event)
Aug 16 12:27:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4eebf4a0-bd4d-483a-847f-d99fd2c9d92c None None] [instance: e0c2b937-066a-490f-a2a2-57ae3dfe814b] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:27:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:27:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:27:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:27:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:27:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:39 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:27:39 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:27:40 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:27:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:41 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:27:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:41 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:27:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:27:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:27:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.356s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:27:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:27:46 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:27:46 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7563MB free_disk=25.282848358154297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Applying migration context for instance 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 as it has an incoming, in-progress migration cd971c95-3720-4147-88e4-4a253a14ea65. Migration status is finished {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 12:27:46 user nova-compute[73520]: INFO nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updating resource usage from migration cd971c95-3720-4147-88e4-4a253a14ea65
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 91e479f7-5fc0-46d2-9c02-52175084fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 27659935-6eb3-4cea-9648-f5820cddda98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Migration cd971c95-3720-4147-88e4-4a253a14ea65 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d712e605-8ee2-4bd5-adce-61d0f284c835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:27:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:27:47 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:27:47 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:27:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:27:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:27:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:27:48 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:27:48 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Updating instance_info_cache with network_info: [{"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:27:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:27:48 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:27:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:27:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:28:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:28:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:28:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:28:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Going to confirm migration 1 {{(pid=73520) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 16 12:28:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:28:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquired lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:28:05 user nova-compute[73520]: DEBUG nova.network.neutron [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:28:05 user nova-compute[73520]: DEBUG nova.objects.instance [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'info_cache' on Instance uuid 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:28:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:06 user nova-compute[73520]: DEBUG nova.network.neutron [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updating instance_info_cache with network_info: [{"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:28:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Releasing lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:28:06 user nova-compute[73520]: DEBUG nova.objects.instance [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'migration_context' on Instance uuid 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:28:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:06 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:28:06 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:28:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.420s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:06 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Deleted allocation for migration cd971c95-3720-4147-88e4-4a253a14ea65
Aug 16 12:28:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-eceb3f5b-2180-49b0-a699-bef9392be4a8 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.561s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "91e479f7-5fc0-46d2-9c02-52175084fbf6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:09 user nova-compute[73520]: INFO nova.compute.manager [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Terminating instance
Aug 16 12:28:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-c0d2ea02-0a4a-4b80-9f0e-a5483fc68988 req-4647729f-a379-4099-a25d-7761a4ab092d service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Received event network-vif-unplugged-2905850b-ae11-4b8f-9f36-8843981fc748 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c0d2ea02-0a4a-4b80-9f0e-a5483fc68988 req-4647729f-a379-4099-a25d-7761a4ab092d service nova] Acquiring lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c0d2ea02-0a4a-4b80-9f0e-a5483fc68988 req-4647729f-a379-4099-a25d-7761a4ab092d service nova] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c0d2ea02-0a4a-4b80-9f0e-a5483fc68988 req-4647729f-a379-4099-a25d-7761a4ab092d service nova] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-c0d2ea02-0a4a-4b80-9f0e-a5483fc68988 req-4647729f-a379-4099-a25d-7761a4ab092d service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] No waiting events found dispatching network-vif-unplugged-2905850b-ae11-4b8f-9f36-8843981fc748 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-c0d2ea02-0a4a-4b80-9f0e-a5483fc68988 req-4647729f-a379-4099-a25d-7761a4ab092d service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Received event network-vif-unplugged-2905850b-ae11-4b8f-9f36-8843981fc748 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:28:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:10 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Instance destroyed successfully.
Aug 16 12:28:10 user nova-compute[73520]: DEBUG nova.objects.instance [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lazy-loading 'resources' on Instance uuid 91e479f7-5fc0-46d2-9c02-52175084fbf6 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1850059560',display_name='tempest-ServersNegativeTestJSON-server-1850059560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1850059560',id=19,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:19:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95f1f97356574bba85e0596dd1b6ed1f',ramdisk_id='',reservation_id='r-k7gtr1zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1387585068',owner_user_name='tempest-ServersNegativeTestJSON-1387585068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:19:21Z,user_data=None,user_id='2a3c953350514bab80c857246568c427',uuid=91e479f7-5fc0-46d2-9c02-52175084fbf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2905850b-ae11-4b8f-9f36-8843981fc748", "address": "fa:16:3e:e5:45:a0", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2905850b-ae", "ovs_interfaceid": "2905850b-ae11-4b8f-9f36-8843981fc748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Converting VIF {"id": "2905850b-ae11-4b8f-9f36-8843981fc748", "address": "fa:16:3e:e5:45:a0", "network": {"id": "79c5289e-3ff8-4a6a-88a7-3bdddfb691ce", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1570904353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95f1f97356574bba85e0596dd1b6ed1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2905850b-ae", "ovs_interfaceid": "2905850b-ae11-4b8f-9f36-8843981fc748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:45:a0,bridge_name='br-int',has_traffic_filtering=True,id=2905850b-ae11-4b8f-9f36-8843981fc748,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2905850b-ae') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG os_vif [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:45:a0,bridge_name='br-int',has_traffic_filtering=True,id=2905850b-ae11-4b8f-9f36-8843981fc748,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2905850b-ae') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2905850b-ae, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:28:10 user nova-compute[73520]: INFO os_vif [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:45:a0,bridge_name='br-int',has_traffic_filtering=True,id=2905850b-ae11-4b8f-9f36-8843981fc748,network=Network(79c5289e-3ff8-4a6a-88a7-3bdddfb691ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2905850b-ae')
Aug 16 12:28:10 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Deleting instance files /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6_del
Aug 16 12:28:10 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Deletion of /opt/stack/data/nova/instances/91e479f7-5fc0-46d2-9c02-52175084fbf6_del complete
Aug 16 12:28:10 user nova-compute[73520]: INFO nova.compute.manager [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 12:28:10 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:28:10 user nova-compute[73520]: INFO nova.compute.manager [None req-c105f873-8ddc-4159-8c8f-74831f81d0de tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Unrescuing
Aug 16 12:28:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c105f873-8ddc-4159-8c8f-74831f81d0de tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c105f873-8ddc-4159-8c8f-74831f81d0de tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquired lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c105f873-8ddc-4159-8c8f-74831f81d0de tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:28:10 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Took 0.66 seconds to deallocate network for instance.
Aug 16 12:28:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c105f873-8ddc-4159-8c8f-74831f81d0de tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Updating instance_info_cache with network_info: [{"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c105f873-8ddc-4159-8c8f-74831f81d0de tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Releasing lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c105f873-8ddc-4159-8c8f-74831f81d0de tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'flavor' on Instance uuid 6ed1c5ac-d727-4157-a294-55b49ed26eea {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:11 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Deleted allocations for instance 91e479f7-5fc0-46d2-9c02-52175084fbf6
Aug 16 12:28:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-433db322-9ea6-4c87-a65d-e1e301740702 tempest-ServersNegativeTestJSON-1387585068 tempest-ServersNegativeTestJSON-1387585068-project-member] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-e9e817cb-bf41-4f2c-8fb1-db3ac0743c62 req-af0d1475-809a-4c5b-9000-58dc3d0009e7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-unplugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e9e817cb-bf41-4f2c-8fb1-db3ac0743c62 req-af0d1475-809a-4c5b-9000-58dc3d0009e7 service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e9e817cb-bf41-4f2c-8fb1-db3ac0743c62 req-af0d1475-809a-4c5b-9000-58dc3d0009e7 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e9e817cb-bf41-4f2c-8fb1-db3ac0743c62 req-af0d1475-809a-4c5b-9000-58dc3d0009e7 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-e9e817cb-bf41-4f2c-8fb1-db3ac0743c62 req-af0d1475-809a-4c5b-9000-58dc3d0009e7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-unplugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:11 user nova-compute[73520]: WARNING nova.compute.manager [req-e9e817cb-bf41-4f2c-8fb1-db3ac0743c62 req-af0d1475-809a-4c5b-9000-58dc3d0009e7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-unplugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:28:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-513e05f7-5e58-4409-be3d-293678c0d215 req-236d4c18-8c38-4cb0-ad6a-afa59f83114e service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Received event network-vif-plugged-2905850b-ae11-4b8f-9f36-8843981fc748 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-513e05f7-5e58-4409-be3d-293678c0d215 req-236d4c18-8c38-4cb0-ad6a-afa59f83114e service nova] Acquiring lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-513e05f7-5e58-4409-be3d-293678c0d215 req-236d4c18-8c38-4cb0-ad6a-afa59f83114e service nova] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-513e05f7-5e58-4409-be3d-293678c0d215 req-236d4c18-8c38-4cb0-ad6a-afa59f83114e service nova] Lock "91e479f7-5fc0-46d2-9c02-52175084fbf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-513e05f7-5e58-4409-be3d-293678c0d215 req-236d4c18-8c38-4cb0-ad6a-afa59f83114e service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] No waiting events found dispatching network-vif-plugged-2905850b-ae11-4b8f-9f36-8843981fc748 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:11 user nova-compute[73520]: WARNING nova.compute.manager [req-513e05f7-5e58-4409-be3d-293678c0d215 req-236d4c18-8c38-4cb0-ad6a-afa59f83114e service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Received unexpected event network-vif-plugged-2905850b-ae11-4b8f-9f36-8843981fc748 for instance with vm_state deleted and task_state None.
Aug 16 12:28:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-513e05f7-5e58-4409-be3d-293678c0d215 req-236d4c18-8c38-4cb0-ad6a-afa59f83114e service nova] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Received event network-vif-deleted-2905850b-ae11-4b8f-9f36-8843981fc748 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:12 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Instance destroyed successfully.
Aug 16 12:28:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "27a51073-9874-453e-b550-5365fa5917eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "27a51073-9874-453e-b550-5365fa5917eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:28:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:12 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:28:12 user nova-compute[73520]: INFO nova.compute.claims [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Claim successful on node user
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.network.neutron [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:28:13 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:28:13 user nova-compute[73520]: INFO nova.virt.block_device [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Booting with volume 302ee37b-8d89-4d04-b0df-72d5e8b6d86d at /dev/vda
Aug 16 12:28:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.policy [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17ed1823b0de433ab523470e235fdd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a693cd27934644be8e64731417c66783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG os_brick.utils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6551dc5a-8460-48c3-af9f-6ac57b1670c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdfa4ae-5786-478a-8343-4aa879502f60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7247981b-6973-4706-9ae2-cbd2e745a265]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e6fd0a-51df-4acc-99ea-3a1fc347162c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:13 user nova-compute[73520]: WARNING nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:13 user nova-compute[73520]: WARNING nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:13 user nova-compute[73520]: WARNING nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-unplugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-unplugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:13 user nova-compute[73520]: WARNING nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-unplugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:13 user nova-compute[73520]: WARNING nova.compute.manager [req-5a02d6ab-3699-433a-88de-a5b6f6fea9b3 req-e6a716c4-59ac-4c98-ab07-30e114b2f3a7 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:28:13 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:28:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5cc078-776c-4d38-a342-e86babbbfc1a]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG os_brick.utils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== get_connector_properties: return (219ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Updating existing volume attachment record: d1a8b1a3-9194-43ad-8e21-0baae6c66421 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:28:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:15 user nova-compute[73520]: DEBUG nova.network.neutron [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Successfully created port: c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:28:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-20ef45f6-48dd-4017-8147-3c42fb879541 req-e3ac3381-9c65-482e-ac66-dfdcd41fb378 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20ef45f6-48dd-4017-8147-3c42fb879541 req-e3ac3381-9c65-482e-ac66-dfdcd41fb378 service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20ef45f6-48dd-4017-8147-3c42fb879541 req-e3ac3381-9c65-482e-ac66-dfdcd41fb378 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20ef45f6-48dd-4017-8147-3c42fb879541 req-e3ac3381-9c65-482e-ac66-dfdcd41fb378 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-20ef45f6-48dd-4017-8147-3c42fb879541 req-e3ac3381-9c65-482e-ac66-dfdcd41fb378 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:15 user nova-compute[73520]: WARNING nova.compute.manager [req-20ef45f6-48dd-4017-8147-3c42fb879541 req-e3ac3381-9c65-482e-ac66-dfdcd41fb378 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:28:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-20ef45f6-48dd-4017-8147-3c42fb879541 req-e3ac3381-9c65-482e-ac66-dfdcd41fb378 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20ef45f6-48dd-4017-8147-3c42fb879541 req-e3ac3381-9c65-482e-ac66-dfdcd41fb378 service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20ef45f6-48dd-4017-8147-3c42fb879541 req-e3ac3381-9c65-482e-ac66-dfdcd41fb378 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20ef45f6-48dd-4017-8147-3c42fb879541 req-e3ac3381-9c65-482e-ac66-dfdcd41fb378 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-20ef45f6-48dd-4017-8147-3c42fb879541 req-e3ac3381-9c65-482e-ac66-dfdcd41fb378 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:15 user nova-compute[73520]: WARNING nova.compute.manager [req-20ef45f6-48dd-4017-8147-3c42fb879541 req-e3ac3381-9c65-482e-ac66-dfdcd41fb378 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:28:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Successfully updated port: c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:28:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "refresh_cache-27a51073-9874-453e-b550-5365fa5917eb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:28:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquired lock "refresh_cache-27a51073-9874-453e-b550-5365fa5917eb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:28:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:28:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:28:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Removed pending event for 6ed1c5ac-d727-4157-a294-55b49ed26eea due to event {{(pid=73520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 12:28:16 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188896.1791794, 6ed1c5ac-d727-4157-a294-55b49ed26eea => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:28:16 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] VM Resumed (Lifecycle Event)
Aug 16 12:28:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c105f873-8ddc-4159-8c8f-74831f81d0de tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:28:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:28:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:28:16 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 12:28:16 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188896.1852267, 6ed1c5ac-d727-4157-a294-55b49ed26eea => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:28:16 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] VM Started (Lifecycle Event)
Aug 16 12:28:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:28:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:28:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Updating instance_info_cache with network_info: [{"id": "c69bc36b-7b76-485b-8230-adefec403ef4", "address": "fa:16:3e:0b:0b:a7", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69bc36b-7b", "ovs_interfaceid": "c69bc36b-7b76-485b-8230-adefec403ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:28:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Releasing lock "refresh_cache-27a51073-9874-453e-b550-5365fa5917eb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:28:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Instance network_info: |[{"id": "c69bc36b-7b76-485b-8230-adefec403ef4", "address": "fa:16:3e:0b:0b:a7", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69bc36b-7b", "ovs_interfaceid": "c69bc36b-7b76-485b-8230-adefec403ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:28:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-ae350f02-eb42-4040-8024-e05164eedbab req-883b3159-b129-4dc6-91d0-fe1283ad3500 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received event network-changed-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-ae350f02-eb42-4040-8024-e05164eedbab req-883b3159-b129-4dc6-91d0-fe1283ad3500 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Refreshing instance network info cache due to event network-changed-c69bc36b-7b76-485b-8230-adefec403ef4. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:28:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ae350f02-eb42-4040-8024-e05164eedbab req-883b3159-b129-4dc6-91d0-fe1283ad3500 service nova] Acquiring lock "refresh_cache-27a51073-9874-453e-b550-5365fa5917eb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:28:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ae350f02-eb42-4040-8024-e05164eedbab req-883b3159-b129-4dc6-91d0-fe1283ad3500 service nova] Acquired lock "refresh_cache-27a51073-9874-453e-b550-5365fa5917eb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:28:17 user nova-compute[73520]: DEBUG nova.network.neutron [req-ae350f02-eb42-4040-8024-e05164eedbab req-883b3159-b129-4dc6-91d0-fe1283ad3500 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Refreshing network info cache for port c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:28:18 user nova-compute[73520]: DEBUG nova.network.neutron [req-ae350f02-eb42-4040-8024-e05164eedbab req-883b3159-b129-4dc6-91d0-fe1283ad3500 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Updated VIF entry in instance network info cache for port c69bc36b-7b76-485b-8230-adefec403ef4. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:28:18 user nova-compute[73520]: DEBUG nova.network.neutron [req-ae350f02-eb42-4040-8024-e05164eedbab req-883b3159-b129-4dc6-91d0-fe1283ad3500 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Updating instance_info_cache with network_info: [{"id": "c69bc36b-7b76-485b-8230-adefec403ef4", "address": "fa:16:3e:0b:0b:a7", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69bc36b-7b", "ovs_interfaceid": "c69bc36b-7b76-485b-8230-adefec403ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:28:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ae350f02-eb42-4040-8024-e05164eedbab req-883b3159-b129-4dc6-91d0-fe1283ad3500 service nova] Releasing lock "refresh_cache-27a51073-9874-453e-b550-5365fa5917eb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:28:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188890.0545242, 91e479f7-5fc0-46d2-9c02-52175084fbf6 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:28:25 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] VM Stopped (Lifecycle Event)
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-3eb7f71f-0024-4444-8e88-6f110ca24927 None None] [instance: 91e479f7-5fc0-46d2-9c02-52175084fbf6] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:28:25 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Creating image(s)
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Ensure instance console log exists: /opt/stack/data/nova/instances/27a51073-9874-453e-b550-5365fa5917eb/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Start _get_guest_xml network_info=[{"id": "c69bc36b-7b76-485b-8230-adefec403ef4", "address": "fa:16:3e:0b:0b:a7", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69bc36b-7b", "ovs_interfaceid": "c69bc36b-7b76-485b-8230-adefec403ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqXJxpaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27a51073-9874-453e-b550-5365fa5917eb', 'attached_at': '', 'detached_at': '', 'volume_id': '302ee37b-8d89-4d04-b0df-72d5e8b6d86d', 'serial': '302ee37b-8d89-4d04-b0df-72d5e8b6d86d'}, 'attachment_id': 'd1a8b1a3-9194-43ad-8e21-0baae6c66421', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:28:25 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:28:25 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqXJxpaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:28:25 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:28:25 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:28:25 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b3e2b6-06a5-45c7-8f7f-d0fddc0d2d97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:28:25 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a4caa1-94f6-4f9f-a8f8-6e686c76e39e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d] added
Aug 16 12:28:25 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[caed2aa4-9795-4116-8a28-5823bf99dccd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8d6b99-e3c9-4ff1-a012-9b96777892eb]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WqXJxpaw {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WqXJxpaw" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[422c4e40-9d46-43a9-a621-ecc5b153005a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WqXJxpaw'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede8698e-f2f5-415b-8e5f-6dbf00f8fbc5]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7829e9ef-c933-48b9-a17e-249484af74a0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:28:25 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:28:25 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:28:25 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:28:25 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a297ded9-bf86-4c41-9f5d-ed38bd03f18f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260]
Aug 16 12:28:25 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260] successful.
Aug 16 12:28:25 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a791fc-df6a-4313-812a-81e9930cc40e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ce5300-6f4a-41af-8620-a627fb357f2d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:28:25 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:28:25 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:28:25 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:28:25 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:28:25 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:28:25 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7bc7e9-23ee-4ed4-88f4-07c2889cdcef]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:28:25 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqXJxpaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23765636232323237', 'path': '/dev/sdd'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765636232323237', 'path': '/dev/sdd'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1528404402',display_name='tempest-TestVolumeBootPattern-server-1528404402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1528404402',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJr/o6vrVZnxmYhfYixlxoifuhCtvsj5vKkg3ZAc0JSOeGoo3PmY57Yx5t3KGcWwXVP9aD5zqccktnbo7190qT8/kMlT5jQNhZVEjx4vkSe9H5//tD72sKPKPHQkEbRmQ==',key_name='tempest-TestVolumeBootPattern-586845281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-jdnrba1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:28:14Z,user_data=None,user_id='17ed1823b0de433ab523470e235fdd72',uuid=27a51073-9874-453e-b550-5365fa5917eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c69bc36b-7b76-485b-8230-adefec403ef4", "address": "fa:16:3e:0b:0b:a7", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69bc36b-7b", "ovs_interfaceid": "c69bc36b-7b76-485b-8230-adefec403ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "c69bc36b-7b76-485b-8230-adefec403ef4", "address": "fa:16:3e:0b:0b:a7", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69bc36b-7b", "ovs_interfaceid": "c69bc36b-7b76-485b-8230-adefec403ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0b:a7,bridge_name='br-int',has_traffic_filtering=True,id=c69bc36b-7b76-485b-8230-adefec403ef4,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69bc36b-7b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG nova.objects.instance [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lazy-loading 'pci_devices' on Instance uuid 27a51073-9874-453e-b550-5365fa5917eb {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:28:26 user nova-compute[73520]:   <uuid>27a51073-9874-453e-b550-5365fa5917eb</uuid>
Aug 16 12:28:26 user nova-compute[73520]:   <name>instance-00000024</name>
Aug 16 12:28:26 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:28:26 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:28:26 user nova-compute[73520]:   <metadata>
Aug 16 12:28:26 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:28:26 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:28:26 user nova-compute[73520]:       <nova:name>tempest-TestVolumeBootPattern-server-1528404402</nova:name>
Aug 16 12:28:26 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:28:25</nova:creationTime>
Aug 16 12:28:26 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:28:26 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:28:26 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:28:26 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:28:26 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:28:26 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:28:26 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:28:26 user nova-compute[73520]:       <nova:owner>
Aug 16 12:28:26 user nova-compute[73520]:         <nova:user uuid="17ed1823b0de433ab523470e235fdd72">tempest-TestVolumeBootPattern-496055159-project-member</nova:user>
Aug 16 12:28:26 user nova-compute[73520]:         <nova:project uuid="a693cd27934644be8e64731417c66783">tempest-TestVolumeBootPattern-496055159</nova:project>
Aug 16 12:28:26 user nova-compute[73520]:       </nova:owner>
Aug 16 12:28:26 user nova-compute[73520]:       <nova:ports>
Aug 16 12:28:26 user nova-compute[73520]:         <nova:port uuid="c69bc36b-7b76-485b-8230-adefec403ef4">
Aug 16 12:28:26 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 12:28:26 user nova-compute[73520]:         </nova:port>
Aug 16 12:28:26 user nova-compute[73520]:       </nova:ports>
Aug 16 12:28:26 user nova-compute[73520]:     </nova:instance>
Aug 16 12:28:26 user nova-compute[73520]:   </metadata>
Aug 16 12:28:26 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:28:26 user nova-compute[73520]:     <system>
Aug 16 12:28:26 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:28:26 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:28:26 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:28:26 user nova-compute[73520]:       <entry name="serial">27a51073-9874-453e-b550-5365fa5917eb</entry>
Aug 16 12:28:26 user nova-compute[73520]:       <entry name="uuid">27a51073-9874-453e-b550-5365fa5917eb</entry>
Aug 16 12:28:26 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:28:26 user nova-compute[73520]:     </system>
Aug 16 12:28:26 user nova-compute[73520]:   </sysinfo>
Aug 16 12:28:26 user nova-compute[73520]:   <os>
Aug 16 12:28:26 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:28:26 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:28:26 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:28:26 user nova-compute[73520]:   </os>
Aug 16 12:28:26 user nova-compute[73520]:   <features>
Aug 16 12:28:26 user nova-compute[73520]:     <acpi/>
Aug 16 12:28:26 user nova-compute[73520]:     <apic/>
Aug 16 12:28:26 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:28:26 user nova-compute[73520]:   </features>
Aug 16 12:28:26 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:28:26 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:28:26 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:28:26 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:28:26 user nova-compute[73520]:   </clock>
Aug 16 12:28:26 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:28:26 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:28:26 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:28:26 user nova-compute[73520]:   </cpu>
Aug 16 12:28:26 user nova-compute[73520]:   <devices>
Aug 16 12:28:26 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:28:26 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:28:26 user nova-compute[73520]:       <source dev="/dev/sdd"/>
Aug 16 12:28:26 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:28:26 user nova-compute[73520]:       <serial>302ee37b-8d89-4d04-b0df-72d5e8b6d86d</serial>
Aug 16 12:28:26 user nova-compute[73520]:     </disk>
Aug 16 12:28:26 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:28:26 user nova-compute[73520]:       <mac address="fa:16:3e:0b:0b:a7"/>
Aug 16 12:28:26 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:28:26 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:28:26 user nova-compute[73520]:       <target dev="tapc69bc36b-7b"/>
Aug 16 12:28:26 user nova-compute[73520]:     </interface>
Aug 16 12:28:26 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:28:26 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/27a51073-9874-453e-b550-5365fa5917eb/console.log" append="off"/>
Aug 16 12:28:26 user nova-compute[73520]:     </serial>
Aug 16 12:28:26 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:28:26 user nova-compute[73520]:     <video>
Aug 16 12:28:26 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:28:26 user nova-compute[73520]:     </video>
Aug 16 12:28:26 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:28:26 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:28:26 user nova-compute[73520]:     </rng>
Aug 16 12:28:26 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:28:26 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:28:26 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:28:26 user nova-compute[73520]:     </memballoon>
Aug 16 12:28:26 user nova-compute[73520]:   </devices>
Aug 16 12:28:26 user nova-compute[73520]: </domain>
Aug 16 12:28:26 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1528404402',display_name='tempest-TestVolumeBootPattern-server-1528404402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1528404402',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJr/o6vrVZnxmYhfYixlxoifuhCtvsj5vKkg3ZAc0JSOeGoo3PmY57Yx5t3KGcWwXVP9aD5zqccktnbo7190qT8/kMlT5jQNhZVEjx4vkSe9H5//tD72sKPKPHQkEbRmQ==',key_name='tempest-TestVolumeBootPattern-586845281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-jdnrba1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:28:14Z,user_data=None,user_id='17ed1823b0de433ab523470e235fdd72',uuid=27a51073-9874-453e-b550-5365fa5917eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c69bc36b-7b76-485b-8230-adefec403ef4", "address": "fa:16:3e:0b:0b:a7", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69bc36b-7b", "ovs_interfaceid": "c69bc36b-7b76-485b-8230-adefec403ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "c69bc36b-7b76-485b-8230-adefec403ef4", "address": "fa:16:3e:0b:0b:a7", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69bc36b-7b", "ovs_interfaceid": "c69bc36b-7b76-485b-8230-adefec403ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0b:a7,bridge_name='br-int',has_traffic_filtering=True,id=c69bc36b-7b76-485b-8230-adefec403ef4,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69bc36b-7b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG os_vif [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0b:a7,bridge_name='br-int',has_traffic_filtering=True,id=c69bc36b-7b76-485b-8230-adefec403ef4,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69bc36b-7b') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc69bc36b-7b, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc69bc36b-7b, col_values=(('external_ids', {'iface-id': 'c69bc36b-7b76-485b-8230-adefec403ef4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:0b:a7', 'vm-uuid': '27a51073-9874-453e-b550-5365fa5917eb'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:26 user nova-compute[73520]: INFO os_vif [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0b:a7,bridge_name='br-int',has_traffic_filtering=True,id=c69bc36b-7b76-485b-8230-adefec403ef4,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69bc36b-7b')
Aug 16 12:28:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:28:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] No VIF found with MAC fa:16:3e:0b:0b:a7, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:28:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-7543f07c-b7e7-4cf4-a3de-21f95c68f13b req-eea81473-f807-4207-b134-183b93e5247f service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received event network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7543f07c-b7e7-4cf4-a3de-21f95c68f13b req-eea81473-f807-4207-b134-183b93e5247f service nova] Acquiring lock "27a51073-9874-453e-b550-5365fa5917eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7543f07c-b7e7-4cf4-a3de-21f95c68f13b req-eea81473-f807-4207-b134-183b93e5247f service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7543f07c-b7e7-4cf4-a3de-21f95c68f13b req-eea81473-f807-4207-b134-183b93e5247f service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-7543f07c-b7e7-4cf4-a3de-21f95c68f13b req-eea81473-f807-4207-b134-183b93e5247f service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] No waiting events found dispatching network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:28 user nova-compute[73520]: WARNING nova.compute.manager [req-7543f07c-b7e7-4cf4-a3de-21f95c68f13b req-eea81473-f807-4207-b134-183b93e5247f service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received unexpected event network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 for instance with vm_state building and task_state spawning.
Aug 16 12:28:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188910.1674938, 27a51073-9874-453e-b550-5365fa5917eb => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:28:30 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27a51073-9874-453e-b550-5365fa5917eb] VM Resumed (Lifecycle Event)
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:28:30 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Instance spawned successfully.
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:28:30 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27a51073-9874-453e-b550-5365fa5917eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188910.1704144, 27a51073-9874-453e-b550-5365fa5917eb => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:28:30 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27a51073-9874-453e-b550-5365fa5917eb] VM Started (Lifecycle Event)
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:28:30 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27a51073-9874-453e-b550-5365fa5917eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:28:30 user nova-compute[73520]: INFO nova.compute.manager [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:28:30 user nova-compute[73520]: INFO nova.compute.manager [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Took 17.64 seconds to build instance.
Aug 16 12:28:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3cf85dad-acb0-4196-81aa-6f935f023374 tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "27a51073-9874-453e-b550-5365fa5917eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.743s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-5becd97a-ed2c-41a8-bc04-b6bdaa501c83 req-a73f1d5d-bf2d-4bac-9e15-757adb909ba3 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received event network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5becd97a-ed2c-41a8-bc04-b6bdaa501c83 req-a73f1d5d-bf2d-4bac-9e15-757adb909ba3 service nova] Acquiring lock "27a51073-9874-453e-b550-5365fa5917eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5becd97a-ed2c-41a8-bc04-b6bdaa501c83 req-a73f1d5d-bf2d-4bac-9e15-757adb909ba3 service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5becd97a-ed2c-41a8-bc04-b6bdaa501c83 req-a73f1d5d-bf2d-4bac-9e15-757adb909ba3 service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-5becd97a-ed2c-41a8-bc04-b6bdaa501c83 req-a73f1d5d-bf2d-4bac-9e15-757adb909ba3 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] No waiting events found dispatching network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:30 user nova-compute[73520]: WARNING nova.compute.manager [req-5becd97a-ed2c-41a8-bc04-b6bdaa501c83 req-a73f1d5d-bf2d-4bac-9e15-757adb909ba3 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received unexpected event network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 for instance with vm_state active and task_state None.
Aug 16 12:28:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:37 user nova-compute[73520]: INFO nova.compute.manager [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Unshelving
Aug 16 12:28:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'pci_requests' on Instance uuid 61633714-d25e-4cde-b757-b3c3f6fd8d71 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:28:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'numa_topology' on Instance uuid 61633714-d25e-4cde-b757-b3c3f6fd8d71 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:28:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:28:37 user nova-compute[73520]: INFO nova.compute.claims [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Claim successful on node user
Aug 16 12:28:38 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:28:38 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:28:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:38 user nova-compute[73520]: INFO nova.network.neutron [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Updating port e230cf5f-ff43-476e-b808-41f0c3f11963 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 12:28:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:28:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquired lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:28:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:28:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:28:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:28:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-7b44ec9e-6148-4533-8bd5-df75089f614d req-16240af2-4ac6-4579-be0a-4932dcf22692 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received event network-changed-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-7b44ec9e-6148-4533-8bd5-df75089f614d req-16240af2-4ac6-4579-be0a-4932dcf22692 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Refreshing instance network info cache due to event network-changed-e230cf5f-ff43-476e-b808-41f0c3f11963. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7b44ec9e-6148-4533-8bd5-df75089f614d req-16240af2-4ac6-4579-be0a-4932dcf22692 service nova] Acquiring lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG nova.network.neutron [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Updating instance_info_cache with network_info: [{"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Releasing lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:28:39 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Creating image(s)
Aug 16 12:28:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "/opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "/opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "/opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG nova.objects.instance [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'trusted_certs' on Instance uuid 61633714-d25e-4cde-b757-b3c3f6fd8d71 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7b44ec9e-6148-4533-8bd5-df75089f614d req-16240af2-4ac6-4579-be0a-4932dcf22692 service nova] Acquired lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG nova.network.neutron [req-7b44ec9e-6148-4533-8bd5-df75089f614d req-16240af2-4ac6-4579-be0a-4932dcf22692 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Refreshing network info cache for port e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05.part --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05.part --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:40 user nova-compute[73520]: DEBUG nova.virt.images [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] ca1deef4-63cd-427b-8f95-7631563ac419 was qcow2, converting to raw {{(pid=73520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 12:28:40 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:28:40 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05.part /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05.converted {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:40 user nova-compute[73520]: DEBUG nova.network.neutron [req-7b44ec9e-6148-4533-8bd5-df75089f614d req-16240af2-4ac6-4579-be0a-4932dcf22692 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Updated VIF entry in instance network info cache for port e230cf5f-ff43-476e-b808-41f0c3f11963. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:28:40 user nova-compute[73520]: DEBUG nova.network.neutron [req-7b44ec9e-6148-4533-8bd5-df75089f614d req-16240af2-4ac6-4579-be0a-4932dcf22692 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Updating instance_info_cache with network_info: [{"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:28:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7b44ec9e-6148-4533-8bd5-df75089f614d req-16240af2-4ac6-4579-be0a-4932dcf22692 service nova] Releasing lock "refresh_cache-61633714-d25e-4cde-b757-b3c3f6fd8d71" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:28:40 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05.part /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05.converted" returned: 0 in 0.644s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05.converted --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.164s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05 --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05 --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05,backing_fmt=raw /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05,backing_fmt=raw /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk 1073741824" returned: 0 in 0.053s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05 --force-share --output=json" returned: 0 in 0.175s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:42 user nova-compute[73520]: DEBUG nova.objects.instance [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'migration_context' on Instance uuid 61633714-d25e-4cde-b757-b3c3f6fd8d71 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:28:42 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Rebasing disk image.
Aug 16 12:28:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 -F raw /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:28:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:28:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:43 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:28:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:28:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 -F raw /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk" returned: 0 in 3.565s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Ensure instance console log exists: /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:28:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Start _get_guest_xml network_info=[{"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='87c55fc35d1ec6cf9eadce8bd6b04c7f',container_format='bare',created_at=2023-08-16T12:26:45Z,direct_url=<?>,disk_format='qcow2',id=ca1deef4-63cd-427b-8f95-7631563ac419,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1180361508-shelved',owner='ed29e455a840474b8a1407af538883ab',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T12:26:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:28:46 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:28:46 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87c55fc35d1ec6cf9eadce8bd6b04c7f',container_format='bare',created_at=2023-08-16T12:26:45Z,direct_url=<?>,disk_format='qcow2',id=ca1deef4-63cd-427b-8f95-7631563ac419,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1180361508-shelved',owner='ed29e455a840474b8a1407af538883ab',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T12:26:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.objects.instance [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'vcpu_model' on Instance uuid 61633714-d25e-4cde-b757-b3c3f6fd8d71 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1180361508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1180361508',id=33,image_ref='ca1deef4-63cd-427b-8f95-7631563ac419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1175824880',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ed29e455a840474b8a1407af538883ab',ramdisk_id='',reservation_id='r-70vxdm7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-974908846',owner_user_name='tempest-AttachVolumeShelveTestJSON-974908846-project-member',shelved_at='2023-08-16T12:26:49.519730',shelved_host='user',shelved_image_id='ca1deef4-63cd-427b-8f95-7631563ac419'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:28:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7e48ee408e24af083b40b19437cfbac',uuid=61633714-d25e-4cde-b757-b3c3f6fd8d71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converting VIF {"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.objects.instance [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'pci_devices' on Instance uuid 61633714-d25e-4cde-b757-b3c3f6fd8d71 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:28:46 user nova-compute[73520]:   <uuid>61633714-d25e-4cde-b757-b3c3f6fd8d71</uuid>
Aug 16 12:28:46 user nova-compute[73520]:   <name>instance-00000021</name>
Aug 16 12:28:46 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:28:46 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:28:46 user nova-compute[73520]:   <metadata>
Aug 16 12:28:46 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:28:46 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:28:46 user nova-compute[73520]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1180361508</nova:name>
Aug 16 12:28:46 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:28:46</nova:creationTime>
Aug 16 12:28:46 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:28:46 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:28:46 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:28:46 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:28:46 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:28:46 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:28:46 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:28:46 user nova-compute[73520]:       <nova:owner>
Aug 16 12:28:46 user nova-compute[73520]:         <nova:user uuid="b7e48ee408e24af083b40b19437cfbac">tempest-AttachVolumeShelveTestJSON-974908846-project-member</nova:user>
Aug 16 12:28:46 user nova-compute[73520]:         <nova:project uuid="ed29e455a840474b8a1407af538883ab">tempest-AttachVolumeShelveTestJSON-974908846</nova:project>
Aug 16 12:28:46 user nova-compute[73520]:       </nova:owner>
Aug 16 12:28:46 user nova-compute[73520]:       <nova:root type="image" uuid="ca1deef4-63cd-427b-8f95-7631563ac419"/>
Aug 16 12:28:46 user nova-compute[73520]:       <nova:ports>
Aug 16 12:28:46 user nova-compute[73520]:         <nova:port uuid="e230cf5f-ff43-476e-b808-41f0c3f11963">
Aug 16 12:28:46 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 12:28:46 user nova-compute[73520]:         </nova:port>
Aug 16 12:28:46 user nova-compute[73520]:       </nova:ports>
Aug 16 12:28:46 user nova-compute[73520]:     </nova:instance>
Aug 16 12:28:46 user nova-compute[73520]:   </metadata>
Aug 16 12:28:46 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:28:46 user nova-compute[73520]:     <system>
Aug 16 12:28:46 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:28:46 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:28:46 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:28:46 user nova-compute[73520]:       <entry name="serial">61633714-d25e-4cde-b757-b3c3f6fd8d71</entry>
Aug 16 12:28:46 user nova-compute[73520]:       <entry name="uuid">61633714-d25e-4cde-b757-b3c3f6fd8d71</entry>
Aug 16 12:28:46 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:28:46 user nova-compute[73520]:     </system>
Aug 16 12:28:46 user nova-compute[73520]:   </sysinfo>
Aug 16 12:28:46 user nova-compute[73520]:   <os>
Aug 16 12:28:46 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:28:46 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:28:46 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:28:46 user nova-compute[73520]:   </os>
Aug 16 12:28:46 user nova-compute[73520]:   <features>
Aug 16 12:28:46 user nova-compute[73520]:     <acpi/>
Aug 16 12:28:46 user nova-compute[73520]:     <apic/>
Aug 16 12:28:46 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:28:46 user nova-compute[73520]:   </features>
Aug 16 12:28:46 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:28:46 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:28:46 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:28:46 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:28:46 user nova-compute[73520]:   </clock>
Aug 16 12:28:46 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:28:46 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:28:46 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:28:46 user nova-compute[73520]:   </cpu>
Aug 16 12:28:46 user nova-compute[73520]:   <devices>
Aug 16 12:28:46 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:28:46 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:28:46 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk"/>
Aug 16 12:28:46 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:28:46 user nova-compute[73520]:     </disk>
Aug 16 12:28:46 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:28:46 user nova-compute[73520]:       <mac address="fa:16:3e:6b:ec:94"/>
Aug 16 12:28:46 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:28:46 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:28:46 user nova-compute[73520]:       <target dev="tape230cf5f-ff"/>
Aug 16 12:28:46 user nova-compute[73520]:     </interface>
Aug 16 12:28:46 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:28:46 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/console.log" append="off"/>
Aug 16 12:28:46 user nova-compute[73520]:     </serial>
Aug 16 12:28:46 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:28:46 user nova-compute[73520]:     <video>
Aug 16 12:28:46 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:28:46 user nova-compute[73520]:     </video>
Aug 16 12:28:46 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:28:46 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:28:46 user nova-compute[73520]:     </rng>
Aug 16 12:28:46 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:28:46 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:28:46 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:28:46 user nova-compute[73520]:     </memballoon>
Aug 16 12:28:46 user nova-compute[73520]:   </devices>
Aug 16 12:28:46 user nova-compute[73520]: </domain>
Aug 16 12:28:46 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1180361508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1180361508',id=33,image_ref='ca1deef4-63cd-427b-8f95-7631563ac419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1175824880',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ed29e455a840474b8a1407af538883ab',ramdisk_id='',reservation_id='r-70vxdm7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-974908846',owner_user_name='tempest-AttachVolumeShelveTestJSON-974908846-project-member',shelved_at='2023-08-16T12:26:49.519730',shelved_host='user',shelved_image_id='ca1deef4-63cd-427b-8f95-7631563ac419'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:28:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7e48ee408e24af083b40b19437cfbac',uuid=61633714-d25e-4cde-b757-b3c3f6fd8d71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converting VIF {"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG os_vif [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape230cf5f-ff, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape230cf5f-ff, col_values=(('external_ids', {'iface-id': 'e230cf5f-ff43-476e-b808-41f0c3f11963', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:ec:94', 'vm-uuid': '61633714-d25e-4cde-b757-b3c3f6fd8d71'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:46 user nova-compute[73520]: INFO os_vif [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff')
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] No VIF found with MAC fa:16:3e:6b:ec:94, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:28:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188929.7131004, 61633714-d25e-4cde-b757-b3c3f6fd8d71 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:28:50 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] VM Resumed (Lifecycle Event)
Aug 16 12:28:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-9115adb3-ab0f-45fa-957b-34eb17990a45 req-23862178-947a-4050-93e7-bfa7d8b04568 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received event network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9115adb3-ab0f-45fa-957b-34eb17990a45 req-23862178-947a-4050-93e7-bfa7d8b04568 service nova] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9115adb3-ab0f-45fa-957b-34eb17990a45 req-23862178-947a-4050-93e7-bfa7d8b04568 service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9115adb3-ab0f-45fa-957b-34eb17990a45 req-23862178-947a-4050-93e7-bfa7d8b04568 service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-9115adb3-ab0f-45fa-957b-34eb17990a45 req-23862178-947a-4050-93e7-bfa7d8b04568 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] No waiting events found dispatching network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:50 user nova-compute[73520]: WARNING nova.compute.manager [req-9115adb3-ab0f-45fa-957b-34eb17990a45 req-23862178-947a-4050-93e7-bfa7d8b04568 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received unexpected event network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-789bd2e1-5b30-4ef4-bc7a-13de9cf9ef63 req-16818efe-6044-41d7-8fd3-aa03db2b6972 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received event network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-789bd2e1-5b30-4ef4-bc7a-13de9cf9ef63 req-16818efe-6044-41d7-8fd3-aa03db2b6972 service nova] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-789bd2e1-5b30-4ef4-bc7a-13de9cf9ef63 req-16818efe-6044-41d7-8fd3-aa03db2b6972 service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-789bd2e1-5b30-4ef4-bc7a-13de9cf9ef63 req-16818efe-6044-41d7-8fd3-aa03db2b6972 service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-789bd2e1-5b30-4ef4-bc7a-13de9cf9ef63 req-16818efe-6044-41d7-8fd3-aa03db2b6972 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] No waiting events found dispatching network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:28:50 user nova-compute[73520]: WARNING nova.compute.manager [req-789bd2e1-5b30-4ef4-bc7a-13de9cf9ef63 req-16818efe-6044-41d7-8fd3-aa03db2b6972 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received unexpected event network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:28:50 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Instance spawned successfully.
Aug 16 12:28:50 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:28:50 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7594MB free_disk=25.199665069580078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:28:50 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188929.7140515, 61633714-d25e-4cde-b757-b3c3f6fd8d71 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:28:50 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] VM Started (Lifecycle Event)
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:28:50 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ee3e847e-a9b9-418d-9663-53a276ade532 tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.782s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 27659935-6eb3-4cea-9648-f5820cddda98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d712e605-8ee2-4bd5-adce-61d0f284c835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 27a51073-9874-453e-b550-5365fa5917eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (70dde5f5-9594-47c3-954e-598dd3089747): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing inventories for resource provider 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating ProviderTree inventory for provider 70dde5f5-9594-47c3-954e-598dd3089747 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing aggregate associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, aggregates: None {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing trait associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.814s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] There are 0 instances to clean {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 12:28:50 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:28:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:52 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:28:52 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:28:52 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:28:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:28:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:28:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:28:53 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:28:53 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Updating instance_info_cache with network_info: [{"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:28:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:28:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:28:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:28:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:29:05 user nova-compute[73520]: INFO nova.compute.manager [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] instance snapshotting
Aug 16 12:29:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Beginning live snapshot process
Aug 16 12:29:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json -f qcow2 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json -f qcow2 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:05 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.456s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmrjqt7e2/8f0590dadafe4daab54a93d59e085786.delta 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmrjqt7e2/8f0590dadafe4daab54a93d59e085786.delta 1073741824" returned: 0 in 0.122s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:06 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 12:29:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:29:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] COPY block job progress, current cursor: 18350080 final cursor: 75497472 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:29:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:29:08 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 12:29:08 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:29:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmrjqt7e2/8f0590dadafe4daab54a93d59e085786.delta /opt/stack/data/nova/instances/snapshots/tmpmrjqt7e2/8f0590dadafe4daab54a93d59e085786 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmrjqt7e2/8f0590dadafe4daab54a93d59e085786.delta /opt/stack/data/nova/instances/snapshots/tmpmrjqt7e2/8f0590dadafe4daab54a93d59e085786" returned: 0 in 0.461s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:08 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Snapshot extracted, beginning image upload
Aug 16 12:29:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 443357b7-2fc9-4ac7-8fce-7dc2bede4369 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 14e89425-93b9-4005-bee2-2b7cc871ee13 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 6ed1c5ac-d727-4157-a294-55b49ed26eea {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 4926037c-8e89-4923-940f-9837b053b9a0 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 61633714-d25e-4cde-b757-b3c3f6fd8d71 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid d712e605-8ee2-4bd5-adce-61d0f284c835 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 27a51073-9874-453e-b550-5365fa5917eb {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "14e89425-93b9-4005-bee2-2b7cc871ee13" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "4926037c-8e89-4923-940f-9837b053b9a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "4926037c-8e89-4923-940f-9837b053b9a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "27659935-6eb3-4cea-9648-f5820cddda98" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "d712e605-8ee2-4bd5-adce-61d0f284c835" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:09 user nova-compute[73520]: INFO nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] During sync_power_state the instance has a pending task (image_uploading). Skip.
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "27a51073-9874-453e-b550-5365fa5917eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "27a51073-9874-453e-b550-5365fa5917eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "4926037c-8e89-4923-940f-9837b053b9a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "27659935-6eb3-4cea-9648-f5820cddda98" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "27a51073-9874-453e-b550-5365fa5917eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Snapshot image upload complete
Aug 16 12:29:11 user nova-compute[73520]: INFO nova.compute.manager [None req-4795bbe7-0004-4424-854a-b9cda69909db tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Took 6.06 seconds to snapshot the instance on the hypervisor.
Aug 16 12:29:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "27659935-6eb3-4cea-9648-f5820cddda98" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lazy-loading 'flavor' on Instance uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "27659935-6eb3-4cea-9648-f5820cddda98" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "27659935-6eb3-4cea-9648-f5820cddda98" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:15 user nova-compute[73520]: INFO nova.compute.manager [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Attaching volume ccfc736d-08db-4664-b12e-9955e4fc00f7 to /dev/vdb
Aug 16 12:29:15 user nova-compute[73520]: DEBUG os_brick.utils [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[235e6712-42c7-4dee-86a8-21dca4a225b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f35e4b-a4c2-4858-b61c-d54ae2b52a0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[82592184-3ed9-47ec-9de9-b345befcdc0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bb2eaf-2866-45ea-bfcd-b11a169b9297]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:29:15 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:29:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e92684-5535-4f57-a6d6-d1212e95d519]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG os_brick.utils [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:29:15 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating existing volume attachment record: 622b38e3-1b5f-4d6b-9cf5-4aaeb5aff794 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:29:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSLAzyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:29:26 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:29:26 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:29:26 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1356e0-12dc-4dd7-8963-5934c79d01a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:29:26 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfe9c09-7559-4683-b847-450ee6f9d423]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7] added
Aug 16 12:29:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ef57c1-612c-4ec1-9a96-ed5eeb138caa]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5368cf86-d24e-434b-a3c6-c0ca0386bbef]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSLAzyXG {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSLAzyXG" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[011e77aa-4357-4af2-9632-83f399e5a767]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WSLAzyXG'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad33a5a-a6f5-4f9c-8f1c-dc553cb4ab9c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ba823f-abac-40e6-8365-6d64a3dd00fd]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:29:26 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:29:26 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:29:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:29:26 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:29:26 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:29:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b955eae-0b3a-4798-a29b-6b479d0b6da5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260]
Aug 16 12:29:26 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260] successful.
Aug 16 12:29:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f795d7a-b86e-4e36-af28-1235d51fcfbd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[116e180d-83ce-4496-b407-b23cda4b4b7b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:29:26 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:29:26 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:29:26 user nova-compute[73520]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:29:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:29:26 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:29:26 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:29:26 user nova-compute[73520]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:29:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9731844-b16d-40b3-85c1-1b4b248fc7df]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:29:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSLAzyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:29:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:29:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23134663837613561', 'path': '/dev/sde'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:29:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134663837613561', 'path': '/dev/sde'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:29:27 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lazy-loading 'flavor' on Instance uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:29:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:29:28 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:29:28 user nova-compute[73520]:   <source dev="/dev/sde"/>
Aug 16 12:29:28 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:29:28 user nova-compute[73520]:   <serial>ccfc736d-08db-4664-b12e-9955e4fc00f7</serial>
Aug 16 12:29:28 user nova-compute[73520]: </disk>
Aug 16 12:29:28 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:29:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:29:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:29:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] No VIF found with MAC fa:16:3e:e5:78:5d, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:29:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fd63e539-99b4-40e8-b926-8f8c5c6e1b2c tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "27659935-6eb3-4cea-9648-f5820cddda98" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.966s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:29:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:29:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:29:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:29:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:31 user nova-compute[73520]: DEBUG nova.compute.manager [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Stashing vm_state: active {{(pid=73520) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 12:29:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:31 user nova-compute[73520]: DEBUG nova.objects.instance [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lazy-loading 'pci_requests' on Instance uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:29:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:29:31 user nova-compute[73520]: INFO nova.compute.claims [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Claim successful on node user
Aug 16 12:29:31 user nova-compute[73520]: DEBUG nova.objects.instance [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lazy-loading 'resources' on Instance uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:29:31 user nova-compute[73520]: DEBUG nova.objects.instance [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lazy-loading 'pci_devices' on Instance uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:29:31 user nova-compute[73520]: INFO nova.compute.resource_tracker [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating resource usage from migration 2a6a042f-bef8-4b14-a008-d9d583fef295
Aug 16 12:29:32 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:29:32 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:29:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.584s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:32 user nova-compute[73520]: INFO nova.compute.manager [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Migrating
Aug 16 12:29:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:29:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquired lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:29:32 user nova-compute[73520]: DEBUG nova.network.neutron [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:29:32 user nova-compute[73520]: DEBUG nova.network.neutron [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating instance_info_cache with network_info: [{"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:29:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Releasing lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Starting migrate_disk_and_power_off {{(pid=73520) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-4ea9697d-2992-41b0-a9c7-3820899a3fd2 req-4108670c-be9c-449f-aae2-27fc56fb2084 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-unplugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4ea9697d-2992-41b0-a9c7-3820899a3fd2 req-4108670c-be9c-449f-aae2-27fc56fb2084 service nova] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4ea9697d-2992-41b0-a9c7-3820899a3fd2 req-4108670c-be9c-449f-aae2-27fc56fb2084 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4ea9697d-2992-41b0-a9c7-3820899a3fd2 req-4108670c-be9c-449f-aae2-27fc56fb2084 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-4ea9697d-2992-41b0-a9c7-3820899a3fd2 req-4108670c-be9c-449f-aae2-27fc56fb2084 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] No waiting events found dispatching network-vif-unplugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:29:33 user nova-compute[73520]: WARNING nova.compute.manager [req-4ea9697d-2992-41b0-a9c7-3820899a3fd2 req-4108670c-be9c-449f-aae2-27fc56fb2084 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received unexpected event network-vif-unplugged-8018c557-722c-41a7-91e0-f63bc6568bac for instance with vm_state active and task_state resize_migrating.
Aug 16 12:29:33 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Instance destroyed successfully.
Aug 16 12:29:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:25:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-576632488',display_name='tempest-ServerActionsTestOtherB-server-576632488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-576632488',id=34,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa+wt9FJevF0VcG5IW9UPpcwllZecsxipO+cOwPONy0JXrxwIIn5VueYzwt5Y4Fz26HPB5B2yhLRiuQ1H/JJF0RqBlDYiGwQFxVVbFuKbbBpDS5B0RYzbNj/n52YCPO2A==',key_name='tempest-keypair-872928149',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:25:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='65805b8eab71460caf571e52648c40d4',ramdisk_id='',reservation_id='r-54clw1uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1849139886',owner_user_name='tempest-ServerActionsTestOtherB-1849139886-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:29:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='354985a41cf846dab967f7d238e19319',uuid=27659935-6eb3-4cea-9648-f5820cddda98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-631465464-network", "vif_mac": "fa:16:3e:e5:78:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converting VIF {"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-631465464-network", "vif_mac": "fa:16:3e:e5:78:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG os_vif [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8018c557-72, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:33 user nova-compute[73520]: INFO os_vif [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72')
Aug 16 12:29:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSLAzyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:29:33 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:29:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c7aecf-a811-4c6b-87b8-d4a10ba8bc84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[35843a7b-8886-4762-95e8-fd883d412023]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:29:33 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:29:33 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:29:33 user nova-compute[73520]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:29:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:29:33 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:29:33 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:29:33 user nova-compute[73520]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:29:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c6d3520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7'): ({'sde'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Removing single pathed devices sde {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4778c2e6-9283-45ee-af49-b64df6c6e900]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[93af21e1-1b06-429d-b7df-305ef7e40d7d]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Flushing IO for device /dev/sde {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caeb0e4-f3b7-4826-86dd-e9dff7baca16]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:29:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0210b8-10f4-4564-ac19-f10914777b94]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba733cd7-5bd4-497b-9eac-48358b0b1920]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ab2af4-534d-4378-8b40-668ea47317cc]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260]
Aug 16 12:29:34 user nova-compute[73520]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260] successful.
Aug 16 12:29:34 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb737545-6165-4af5-bab5-96072d664657]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] <== disconnect_volume: return (326ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98_resize/disk /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CMD "cp -r /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98_resize/disk /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk" returned: 0 in 0.297s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98_resize/disk.info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk.info {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CMD "cp -r /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98_resize/disk.info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk.info" returned: 0 in 0.037s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-a99016f8-7b71-4c58-92ba-016bf94d77df req-693ec14c-616d-4cc6-818f-4280c5d72662 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:29:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a99016f8-7b71-4c58-92ba-016bf94d77df req-693ec14c-616d-4cc6-818f-4280c5d72662 service nova] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a99016f8-7b71-4c58-92ba-016bf94d77df req-693ec14c-616d-4cc6-818f-4280c5d72662 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a99016f8-7b71-4c58-92ba-016bf94d77df req-693ec14c-616d-4cc6-818f-4280c5d72662 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-a99016f8-7b71-4c58-92ba-016bf94d77df req-693ec14c-616d-4cc6-818f-4280c5d72662 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] No waiting events found dispatching network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:29:35 user nova-compute[73520]: WARNING nova.compute.manager [req-a99016f8-7b71-4c58-92ba-016bf94d77df req-693ec14c-616d-4cc6-818f-4280c5d72662 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received unexpected event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac for instance with vm_state active and task_state resize_migrating.
Aug 16 12:29:36 user nova-compute[73520]: DEBUG nova.network.neutron [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Port 8018c557-722c-41a7-91e0-f63bc6568bac binding to destination host user is already ACTIVE {{(pid=73520) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 12:29:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:29:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquired lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:29:36 user nova-compute[73520]: DEBUG nova.network.neutron [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG nova.network.neutron [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating instance_info_cache with network_info: [{"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Releasing lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG os_brick.utils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8d9d41-a64e-473d-89f6-ef91b161da4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd48067-68c7-42d2-a563-8f14395dcafe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ed7782-55f8-4382-8f3f-f63e8dd6f899]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d212e45a-5827-4960-9351-4405fc0c5ea3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:29:37 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:29:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b83f636-f7b1-4a07-a8f2-5c0aaa2aaa75]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:29:37 user nova-compute[73520]: DEBUG os_brick.utils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:29:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:39 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:29:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:39 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:29:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:29:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:41 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:29:41 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:29:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:29:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:43 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:29:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:29:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:44 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:29:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:29:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:29:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:29:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:29:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Starting finish_migration {{(pid=73520) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 12:29:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Instance directory exists: not creating {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 12:29:48 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Creating image(s)
Aug 16 12:29:48 user nova-compute[73520]: DEBUG nova.objects.instance [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lazy-loading 'trusted_certs' on Instance uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:29:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:48 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692188973.8008115, 27659935-6eb3-4cea-9648-f5820cddda98 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:29:48 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] VM Stopped (Lifecycle Event)
Aug 16 12:29:48 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:29:49 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7633MB free_disk=25.190357208251953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-64a0505b-9bd2-4956-921a-7aaf28edb5c2 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-64a0505b-9bd2-4956-921a-7aaf28edb5c2 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:29:49 user nova-compute[73520]: INFO nova.compute.manager [None req-64a0505b-9bd2-4956-921a-7aaf28edb5c2 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 12:29:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Applying migration context for instance 27659935-6eb3-4cea-9648-f5820cddda98 as it has an incoming, in-progress migration 2a6a042f-bef8-4b14-a008-d9d583fef295. Migration status is post-migrating {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 12:29:49 user nova-compute[73520]: INFO nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating resource usage from migration 2a6a042f-bef8-4b14-a008-d9d583fef295
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.208s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk. size=21474836480 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d712e605-8ee2-4bd5-adce-61d0f284c835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 27a51073-9874-453e-b550-5365fa5917eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 61633714-d25e-4cde-b757-b3c3f6fd8d71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Migration 2a6a042f-bef8-4b14-a008-d9d583fef295 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 27659935-6eb3-4cea-9648-f5820cddda98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk 21474836480 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk 21474836480" returned: 0 in 0.055s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Ensure instance console log exists: /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Start _get_guest_xml network_info=[{"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-631465464-network", "vif_mac": "fa:16:3e:e5:78:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSLAzyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '27659935-6eb3-4cea-9648-f5820cddda98', 'attached_at': '2023-08-16T12:29:48.000000', 'detached_at': '', 'volume_id': 'ccfc736d-08db-4664-b12e-9955e4fc00f7', 'serial': 'ccfc736d-08db-4664-b12e-9955e4fc00f7'}, 'attachment_id': '16d2a1e1-13a3-42be-9b66-fe515bee6585', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:29:49 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:29:49 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.objects.instance [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lazy-loading 'vcpu_model' on Instance uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSLAzyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:29:49 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:29:49 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:29:49 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eebee1-2e0f-425d-877a-5b3c0f629fb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:29:49 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a859f735-7b0c-4a9f-a541-6c86fb2384a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7] added
Aug 16 12:29:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf062bfc-8b03-4e58-8409-67bdf9687438]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb7df7d-4364-4331-a0a9-a93a8bdc12db]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSLAzyXG {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSLAzyXG" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa49ac05-9908-48b0-a28a-495175e9616f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WSLAzyXG'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.804s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d374c1ee-85f0-43ba-a615-94b8e656bf75]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cce21d2-23f9-466b-b44b-f2a27e7a676e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:29:49 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:29:49 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:29:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:29:49 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:29:49 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:29:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e504cd4c-8bdc-43e6-9a60-317d964ec965]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260]
Aug 16 12:29:49 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260] successful.
Aug 16 12:29:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0ebd46-31a5-40d6-97d5-abecbd653f03]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b511f6-a510-439c-9f2a-b16c2ba715a7]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:29:49 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:29:49 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:29:49 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:29:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:29:49 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:29:49 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:29:49 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:29:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:29:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c9837b-a11d-49bb-acce-a999c3d9a242]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:29:50 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:29:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSLAzyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:29:50 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:29:50 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:29:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:29:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:29:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:29:50 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23134663837613561', 'path': '/dev/sde'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134663837613561', 'path': '/dev/sde'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:25:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-576632488',display_name='tempest-ServerActionsTestOtherB-server-576632488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-576632488',id=34,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa+wt9FJevF0VcG5IW9UPpcwllZecsxipO+cOwPONy0JXrxwIIn5VueYzwt5Y4Fz26HPB5B2yhLRiuQ1H/JJF0RqBlDYiGwQFxVVbFuKbbBpDS5B0RYzbNj/n52YCPO2A==',key_name='tempest-keypair-872928149',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:25:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='65805b8eab71460caf571e52648c40d4',ramdisk_id='',reservation_id='r-54clw1uk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1849139886',owner_user_name='tempest-ServerActionsTestOtherB-1849139886-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:29:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='354985a41cf846dab967f7d238e19319',uuid=27659935-6eb3-4cea-9648-f5820cddda98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-631465464-network", "vif_mac": "fa:16:3e:e5:78:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converting VIF {"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-631465464-network", "vif_mac": "fa:16:3e:e5:78:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:29:51 user nova-compute[73520]:   <uuid>27659935-6eb3-4cea-9648-f5820cddda98</uuid>
Aug 16 12:29:51 user nova-compute[73520]:   <name>instance-00000022</name>
Aug 16 12:29:51 user nova-compute[73520]:   <memory>2097152</memory>
Aug 16 12:29:51 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:29:51 user nova-compute[73520]:   <metadata>
Aug 16 12:29:51 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:29:51 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:29:51 user nova-compute[73520]:       <nova:name>tempest-ServerActionsTestOtherB-server-576632488</nova:name>
Aug 16 12:29:51 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:29:49</nova:creationTime>
Aug 16 12:29:51 user nova-compute[73520]:       <nova:flavor name="m1.small">
Aug 16 12:29:51 user nova-compute[73520]:         <nova:memory>2048</nova:memory>
Aug 16 12:29:51 user nova-compute[73520]:         <nova:disk>20</nova:disk>
Aug 16 12:29:51 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:29:51 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:29:51 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:29:51 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:29:51 user nova-compute[73520]:       <nova:owner>
Aug 16 12:29:51 user nova-compute[73520]:         <nova:user uuid="354985a41cf846dab967f7d238e19319">tempest-ServerActionsTestOtherB-1849139886-project-member</nova:user>
Aug 16 12:29:51 user nova-compute[73520]:         <nova:project uuid="65805b8eab71460caf571e52648c40d4">tempest-ServerActionsTestOtherB-1849139886</nova:project>
Aug 16 12:29:51 user nova-compute[73520]:       </nova:owner>
Aug 16 12:29:51 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:29:51 user nova-compute[73520]:       <nova:ports>
Aug 16 12:29:51 user nova-compute[73520]:         <nova:port uuid="8018c557-722c-41a7-91e0-f63bc6568bac">
Aug 16 12:29:51 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 12:29:51 user nova-compute[73520]:         </nova:port>
Aug 16 12:29:51 user nova-compute[73520]:       </nova:ports>
Aug 16 12:29:51 user nova-compute[73520]:     </nova:instance>
Aug 16 12:29:51 user nova-compute[73520]:   </metadata>
Aug 16 12:29:51 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:29:51 user nova-compute[73520]:     <system>
Aug 16 12:29:51 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:29:51 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:29:51 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:29:51 user nova-compute[73520]:       <entry name="serial">27659935-6eb3-4cea-9648-f5820cddda98</entry>
Aug 16 12:29:51 user nova-compute[73520]:       <entry name="uuid">27659935-6eb3-4cea-9648-f5820cddda98</entry>
Aug 16 12:29:51 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:29:51 user nova-compute[73520]:     </system>
Aug 16 12:29:51 user nova-compute[73520]:   </sysinfo>
Aug 16 12:29:51 user nova-compute[73520]:   <os>
Aug 16 12:29:51 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:29:51 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:29:51 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:29:51 user nova-compute[73520]:   </os>
Aug 16 12:29:51 user nova-compute[73520]:   <features>
Aug 16 12:29:51 user nova-compute[73520]:     <acpi/>
Aug 16 12:29:51 user nova-compute[73520]:     <apic/>
Aug 16 12:29:51 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:29:51 user nova-compute[73520]:   </features>
Aug 16 12:29:51 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:29:51 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:29:51 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:29:51 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:29:51 user nova-compute[73520]:   </clock>
Aug 16 12:29:51 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:29:51 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:29:51 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:29:51 user nova-compute[73520]:   </cpu>
Aug 16 12:29:51 user nova-compute[73520]:   <devices>
Aug 16 12:29:51 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:29:51 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:29:51 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk"/>
Aug 16 12:29:51 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:29:51 user nova-compute[73520]:     </disk>
Aug 16 12:29:51 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:29:51 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:29:51 user nova-compute[73520]:       <source dev="/dev/sde"/>
Aug 16 12:29:51 user nova-compute[73520]:       <target dev="vdb" bus="virtio"/>
Aug 16 12:29:51 user nova-compute[73520]:       <serial>ccfc736d-08db-4664-b12e-9955e4fc00f7</serial>
Aug 16 12:29:51 user nova-compute[73520]:     </disk>
Aug 16 12:29:51 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:29:51 user nova-compute[73520]:       <mac address="fa:16:3e:e5:78:5d"/>
Aug 16 12:29:51 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:29:51 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:29:51 user nova-compute[73520]:       <target dev="tap8018c557-72"/>
Aug 16 12:29:51 user nova-compute[73520]:     </interface>
Aug 16 12:29:51 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:29:51 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/console.log" append="off"/>
Aug 16 12:29:51 user nova-compute[73520]:     </serial>
Aug 16 12:29:51 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:29:51 user nova-compute[73520]:     <video>
Aug 16 12:29:51 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:29:51 user nova-compute[73520]:     </video>
Aug 16 12:29:51 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:29:51 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:29:51 user nova-compute[73520]:     </rng>
Aug 16 12:29:51 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:29:51 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:29:51 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:29:51 user nova-compute[73520]:     </memballoon>
Aug 16 12:29:51 user nova-compute[73520]:   </devices>
Aug 16 12:29:51 user nova-compute[73520]: </domain>
Aug 16 12:29:51 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:25:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-576632488',display_name='tempest-ServerActionsTestOtherB-server-576632488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-576632488',id=34,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa+wt9FJevF0VcG5IW9UPpcwllZecsxipO+cOwPONy0JXrxwIIn5VueYzwt5Y4Fz26HPB5B2yhLRiuQ1H/JJF0RqBlDYiGwQFxVVbFuKbbBpDS5B0RYzbNj/n52YCPO2A==',key_name='tempest-keypair-872928149',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:25:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='65805b8eab71460caf571e52648c40d4',ramdisk_id='',reservation_id='r-54clw1uk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1849139886',owner_user_name='tempest-ServerActionsTestOtherB-1849139886-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:29:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='354985a41cf846dab967f7d238e19319',uuid=27659935-6eb3-4cea-9648-f5820cddda98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-631465464-network", "vif_mac": "fa:16:3e:e5:78:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converting VIF {"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-631465464-network", "vif_mac": "fa:16:3e:e5:78:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG os_vif [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8018c557-72, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8018c557-72, col_values=(('external_ids', {'iface-id': '8018c557-722c-41a7-91e0-f63bc6568bac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:78:5d', 'vm-uuid': '27659935-6eb3-4cea-9648-f5820cddda98'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:51 user nova-compute[73520]: INFO os_vif [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72')
Aug 16 12:29:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] No VIF found with MAC fa:16:3e:e5:78:5d, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Updating instance_info_cache with network_info: [{"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:29:51 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:29:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:29:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:29:52 user nova-compute[73520]: INFO nova.compute.claims [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Claim successful on node user
Aug 16 12:29:52 user nova-compute[73520]: DEBUG nova.compute.manager [req-643d7698-1095-4b54-8c83-96ddeb015eac req-cc1ae234-1fd7-4ab6-875b-a0bf95276100 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:29:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-643d7698-1095-4b54-8c83-96ddeb015eac req-cc1ae234-1fd7-4ab6-875b-a0bf95276100 service nova] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-643d7698-1095-4b54-8c83-96ddeb015eac req-cc1ae234-1fd7-4ab6-875b-a0bf95276100 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-643d7698-1095-4b54-8c83-96ddeb015eac req-cc1ae234-1fd7-4ab6-875b-a0bf95276100 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:52 user nova-compute[73520]: DEBUG nova.compute.manager [req-643d7698-1095-4b54-8c83-96ddeb015eac req-cc1ae234-1fd7-4ab6-875b-a0bf95276100 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] No waiting events found dispatching network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:29:52 user nova-compute[73520]: WARNING nova.compute.manager [req-643d7698-1095-4b54-8c83-96ddeb015eac req-cc1ae234-1fd7-4ab6-875b-a0bf95276100 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received unexpected event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac for instance with vm_state active and task_state resize_finish.
Aug 16 12:29:53 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG nova.network.neutron [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:29:53 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:29:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG nova.policy [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '161e37aeeab540b888557cad6504b9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16aba93c82b40f08bc0558754584c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:29:53 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Creating image(s)
Aug 16 12:29:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "/opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "/opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "/opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.224s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk 1073741824" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.409s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.256s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG nova.network.neutron [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Successfully created port: 721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Cannot resize image /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG nova.objects.instance [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lazy-loading 'migration_context' on Instance uuid 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Ensure instance console log exists: /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-d16215a6-18d0-45e1-9664-c61a4404b733 req-0cd4437d-ce9d-4270-afd4-a774ef590128 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d16215a6-18d0-45e1-9664-c61a4404b733 req-0cd4437d-ce9d-4270-afd4-a774ef590128 service nova] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d16215a6-18d0-45e1-9664-c61a4404b733 req-0cd4437d-ce9d-4270-afd4-a774ef590128 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d16215a6-18d0-45e1-9664-c61a4404b733 req-0cd4437d-ce9d-4270-afd4-a774ef590128 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-d16215a6-18d0-45e1-9664-c61a4404b733 req-0cd4437d-ce9d-4270-afd4-a774ef590128 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] No waiting events found dispatching network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:29:54 user nova-compute[73520]: WARNING nova.compute.manager [req-d16215a6-18d0-45e1-9664-c61a4404b733 req-0cd4437d-ce9d-4270-afd4-a774ef590128 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received unexpected event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac for instance with vm_state active and task_state resize_finish.
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.network.neutron [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Successfully updated port: 721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "refresh_cache-31c878ee-ff2c-42ff-aa73-453e7d47c6f9" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquired lock "refresh_cache-31c878ee-ff2c-42ff-aa73-453e7d47c6f9" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.network.neutron [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.compute.manager [req-03a86c0a-e260-482a-afab-65f64b3297a6 req-590f6608-cd86-4efe-a970-83edeefbbf33 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Received event network-changed-721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.compute.manager [req-03a86c0a-e260-482a-afab-65f64b3297a6 req-590f6608-cd86-4efe-a970-83edeefbbf33 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Refreshing instance network info cache due to event network-changed-721a7b26-4adf-4711-b0df-6842b589bb78. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-03a86c0a-e260-482a-afab-65f64b3297a6 req-590f6608-cd86-4efe-a970-83edeefbbf33 service nova] Acquiring lock "refresh_cache-31c878ee-ff2c-42ff-aa73-453e7d47c6f9" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188995.127837, 27659935-6eb3-4cea-9648-f5820cddda98 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:29:55 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] VM Resumed (Lifecycle Event)
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.network.neutron [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:29:55 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Instance running successfully.
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Failed to set time: agent not configured {{(pid=73520) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-db9d6b79-b7b7-4a68-b148-6a125ed5d149 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] finish_migration finished successfully. {{(pid=73520) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:29:55 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188995.1286495, 27659935-6eb3-4cea-9648-f5820cddda98 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:29:55 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] VM Started (Lifecycle Event)
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:29:55 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.network.neutron [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Updating instance_info_cache with network_info: [{"id": "721a7b26-4adf-4711-b0df-6842b589bb78", "address": "fa:16:3e:e3:da:c9", "network": {"id": "e257644d-4e85-47bb-99ad-249afdcbfa5b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-376827404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d16aba93c82b40f08bc0558754584c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721a7b26-4a", "ovs_interfaceid": "721a7b26-4adf-4711-b0df-6842b589bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Releasing lock "refresh_cache-31c878ee-ff2c-42ff-aa73-453e7d47c6f9" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Instance network_info: |[{"id": "721a7b26-4adf-4711-b0df-6842b589bb78", "address": "fa:16:3e:e3:da:c9", "network": {"id": "e257644d-4e85-47bb-99ad-249afdcbfa5b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-376827404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d16aba93c82b40f08bc0558754584c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721a7b26-4a", "ovs_interfaceid": "721a7b26-4adf-4711-b0df-6842b589bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-03a86c0a-e260-482a-afab-65f64b3297a6 req-590f6608-cd86-4efe-a970-83edeefbbf33 service nova] Acquired lock "refresh_cache-31c878ee-ff2c-42ff-aa73-453e7d47c6f9" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.network.neutron [req-03a86c0a-e260-482a-afab-65f64b3297a6 req-590f6608-cd86-4efe-a970-83edeefbbf33 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Refreshing network info cache for port 721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Start _get_guest_xml network_info=[{"id": "721a7b26-4adf-4711-b0df-6842b589bb78", "address": "fa:16:3e:e3:da:c9", "network": {"id": "e257644d-4e85-47bb-99ad-249afdcbfa5b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-376827404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d16aba93c82b40f08bc0558754584c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721a7b26-4a", "ovs_interfaceid": "721a7b26-4adf-4711-b0df-6842b589bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:29:55 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:29:55 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-508152035',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-508152035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5081520',id=37,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn+B6cTnP5iDXaNiPa8DlHcI2VCNPyY0ey1Jf1K0+XhtawbZUs6Ts7gmt2MT80eES7eBFWjyh+SaPTlfII4L1ZS3d6kmTpg6jswGY0sKlN28FP1fEuSQuilz5BnMjPW4Q==',key_name='tempest-keypair-1533305561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16aba93c82b40f08bc0558754584c03',ramdisk_id='',reservation_id='r-mtn4yeeg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1003690533',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:29:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='161e37aeeab540b888557cad6504b9e6',uuid=31c878ee-ff2c-42ff-aa73-453e7d47c6f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "721a7b26-4adf-4711-b0df-6842b589bb78", "address": "fa:16:3e:e3:da:c9", "network": {"id": "e257644d-4e85-47bb-99ad-249afdcbfa5b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-376827404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d16aba93c82b40f08bc0558754584c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721a7b26-4a", "ovs_interfaceid": "721a7b26-4adf-4711-b0df-6842b589bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Converting VIF {"id": "721a7b26-4adf-4711-b0df-6842b589bb78", "address": "fa:16:3e:e3:da:c9", "network": {"id": "e257644d-4e85-47bb-99ad-249afdcbfa5b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-376827404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d16aba93c82b40f08bc0558754584c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721a7b26-4a", "ovs_interfaceid": "721a7b26-4adf-4711-b0df-6842b589bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:da:c9,bridge_name='br-int',has_traffic_filtering=True,id=721a7b26-4adf-4711-b0df-6842b589bb78,network=Network(e257644d-4e85-47bb-99ad-249afdcbfa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721a7b26-4a') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.objects.instance [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lazy-loading 'pci_devices' on Instance uuid 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:29:55 user nova-compute[73520]:   <uuid>31c878ee-ff2c-42ff-aa73-453e7d47c6f9</uuid>
Aug 16 12:29:55 user nova-compute[73520]:   <name>instance-00000025</name>
Aug 16 12:29:55 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:29:55 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:29:55 user nova-compute[73520]:   <metadata>
Aug 16 12:29:55 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:29:55 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:29:55 user nova-compute[73520]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-508152035</nova:name>
Aug 16 12:29:55 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:29:55</nova:creationTime>
Aug 16 12:29:55 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:29:55 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:29:55 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:29:55 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:29:55 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:29:55 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:29:55 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:29:55 user nova-compute[73520]:       <nova:owner>
Aug 16 12:29:55 user nova-compute[73520]:         <nova:user uuid="161e37aeeab540b888557cad6504b9e6">tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member</nova:user>
Aug 16 12:29:55 user nova-compute[73520]:         <nova:project uuid="d16aba93c82b40f08bc0558754584c03">tempest-TestServerVolumeAttachScenarioOldVersion-1003690533</nova:project>
Aug 16 12:29:55 user nova-compute[73520]:       </nova:owner>
Aug 16 12:29:55 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:29:55 user nova-compute[73520]:       <nova:ports>
Aug 16 12:29:55 user nova-compute[73520]:         <nova:port uuid="721a7b26-4adf-4711-b0df-6842b589bb78">
Aug 16 12:29:55 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 12:29:55 user nova-compute[73520]:         </nova:port>
Aug 16 12:29:55 user nova-compute[73520]:       </nova:ports>
Aug 16 12:29:55 user nova-compute[73520]:     </nova:instance>
Aug 16 12:29:55 user nova-compute[73520]:   </metadata>
Aug 16 12:29:55 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:29:55 user nova-compute[73520]:     <system>
Aug 16 12:29:55 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:29:55 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:29:55 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:29:55 user nova-compute[73520]:       <entry name="serial">31c878ee-ff2c-42ff-aa73-453e7d47c6f9</entry>
Aug 16 12:29:55 user nova-compute[73520]:       <entry name="uuid">31c878ee-ff2c-42ff-aa73-453e7d47c6f9</entry>
Aug 16 12:29:55 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:29:55 user nova-compute[73520]:     </system>
Aug 16 12:29:55 user nova-compute[73520]:   </sysinfo>
Aug 16 12:29:55 user nova-compute[73520]:   <os>
Aug 16 12:29:55 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:29:55 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:29:55 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:29:55 user nova-compute[73520]:   </os>
Aug 16 12:29:55 user nova-compute[73520]:   <features>
Aug 16 12:29:55 user nova-compute[73520]:     <acpi/>
Aug 16 12:29:55 user nova-compute[73520]:     <apic/>
Aug 16 12:29:55 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:29:55 user nova-compute[73520]:   </features>
Aug 16 12:29:55 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:29:55 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:29:55 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:29:55 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:29:55 user nova-compute[73520]:   </clock>
Aug 16 12:29:55 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:29:55 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:29:55 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:29:55 user nova-compute[73520]:   </cpu>
Aug 16 12:29:55 user nova-compute[73520]:   <devices>
Aug 16 12:29:55 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:29:55 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:29:55 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk"/>
Aug 16 12:29:55 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:29:55 user nova-compute[73520]:     </disk>
Aug 16 12:29:55 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:29:55 user nova-compute[73520]:       <mac address="fa:16:3e:e3:da:c9"/>
Aug 16 12:29:55 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:29:55 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:29:55 user nova-compute[73520]:       <target dev="tap721a7b26-4a"/>
Aug 16 12:29:55 user nova-compute[73520]:     </interface>
Aug 16 12:29:55 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:29:55 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/console.log" append="off"/>
Aug 16 12:29:55 user nova-compute[73520]:     </serial>
Aug 16 12:29:55 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:29:55 user nova-compute[73520]:     <video>
Aug 16 12:29:55 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:29:55 user nova-compute[73520]:     </video>
Aug 16 12:29:55 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:29:55 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:29:55 user nova-compute[73520]:     </rng>
Aug 16 12:29:55 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:29:55 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:29:55 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:29:55 user nova-compute[73520]:     </memballoon>
Aug 16 12:29:55 user nova-compute[73520]:   </devices>
Aug 16 12:29:55 user nova-compute[73520]: </domain>
Aug 16 12:29:55 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-508152035',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-508152035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5081520',id=37,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn+B6cTnP5iDXaNiPa8DlHcI2VCNPyY0ey1Jf1K0+XhtawbZUs6Ts7gmt2MT80eES7eBFWjyh+SaPTlfII4L1ZS3d6kmTpg6jswGY0sKlN28FP1fEuSQuilz5BnMjPW4Q==',key_name='tempest-keypair-1533305561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d16aba93c82b40f08bc0558754584c03',ramdisk_id='',reservation_id='r-mtn4yeeg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1003690533',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:29:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='161e37aeeab540b888557cad6504b9e6',uuid=31c878ee-ff2c-42ff-aa73-453e7d47c6f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "721a7b26-4adf-4711-b0df-6842b589bb78", "address": "fa:16:3e:e3:da:c9", "network": {"id": "e257644d-4e85-47bb-99ad-249afdcbfa5b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-376827404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d16aba93c82b40f08bc0558754584c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721a7b26-4a", "ovs_interfaceid": "721a7b26-4adf-4711-b0df-6842b589bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Converting VIF {"id": "721a7b26-4adf-4711-b0df-6842b589bb78", "address": "fa:16:3e:e3:da:c9", "network": {"id": "e257644d-4e85-47bb-99ad-249afdcbfa5b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-376827404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d16aba93c82b40f08bc0558754584c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721a7b26-4a", "ovs_interfaceid": "721a7b26-4adf-4711-b0df-6842b589bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:da:c9,bridge_name='br-int',has_traffic_filtering=True,id=721a7b26-4adf-4711-b0df-6842b589bb78,network=Network(e257644d-4e85-47bb-99ad-249afdcbfa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721a7b26-4a') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG os_vif [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:da:c9,bridge_name='br-int',has_traffic_filtering=True,id=721a7b26-4adf-4711-b0df-6842b589bb78,network=Network(e257644d-4e85-47bb-99ad-249afdcbfa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721a7b26-4a') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap721a7b26-4a, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap721a7b26-4a, col_values=(('external_ids', {'iface-id': '721a7b26-4adf-4711-b0df-6842b589bb78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:da:c9', 'vm-uuid': '31c878ee-ff2c-42ff-aa73-453e7d47c6f9'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:55 user nova-compute[73520]: INFO os_vif [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:da:c9,bridge_name='br-int',has_traffic_filtering=True,id=721a7b26-4adf-4711-b0df-6842b589bb78,network=Network(e257644d-4e85-47bb-99ad-249afdcbfa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721a7b26-4a')
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] No VIF found with MAC fa:16:3e:e3:da:c9, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.network.neutron [req-03a86c0a-e260-482a-afab-65f64b3297a6 req-590f6608-cd86-4efe-a970-83edeefbbf33 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Updated VIF entry in instance network info cache for port 721a7b26-4adf-4711-b0df-6842b589bb78. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG nova.network.neutron [req-03a86c0a-e260-482a-afab-65f64b3297a6 req-590f6608-cd86-4efe-a970-83edeefbbf33 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Updating instance_info_cache with network_info: [{"id": "721a7b26-4adf-4711-b0df-6842b589bb78", "address": "fa:16:3e:e3:da:c9", "network": {"id": "e257644d-4e85-47bb-99ad-249afdcbfa5b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-376827404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d16aba93c82b40f08bc0558754584c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721a7b26-4a", "ovs_interfaceid": "721a7b26-4adf-4711-b0df-6842b589bb78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:29:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-03a86c0a-e260-482a-afab-65f64b3297a6 req-590f6608-cd86-4efe-a970-83edeefbbf33 service nova] Releasing lock "refresh_cache-31c878ee-ff2c-42ff-aa73-453e7d47c6f9" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:29:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:57 user nova-compute[73520]: INFO nova.compute.manager [None req-0394d9c2-7035-40ec-b17a-73f197b45fb3 tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Get console output
Aug 16 12:29:57 user nova-compute[73520]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 16 12:29:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-7449aebc-30bb-407a-aea2-ce986d8afddd req-dcf0b678-5e32-46d4-9a41-c68f75ccd676 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Received event network-vif-plugged-721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:29:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7449aebc-30bb-407a-aea2-ce986d8afddd req-dcf0b678-5e32-46d4-9a41-c68f75ccd676 service nova] Acquiring lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7449aebc-30bb-407a-aea2-ce986d8afddd req-dcf0b678-5e32-46d4-9a41-c68f75ccd676 service nova] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7449aebc-30bb-407a-aea2-ce986d8afddd req-dcf0b678-5e32-46d4-9a41-c68f75ccd676 service nova] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-7449aebc-30bb-407a-aea2-ce986d8afddd req-dcf0b678-5e32-46d4-9a41-c68f75ccd676 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] No waiting events found dispatching network-vif-plugged-721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:29:57 user nova-compute[73520]: WARNING nova.compute.manager [req-7449aebc-30bb-407a-aea2-ce986d8afddd req-dcf0b678-5e32-46d4-9a41-c68f75ccd676 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Received unexpected event network-vif-plugged-721a7b26-4adf-4711-b0df-6842b589bb78 for instance with vm_state building and task_state spawning.
Aug 16 12:29:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-26dc349c-5ab4-47af-a36a-530da68ea843 req-aacbf056-2af7-4b0f-9a42-e33b991a72e4 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Received event network-vif-plugged-721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-26dc349c-5ab4-47af-a36a-530da68ea843 req-aacbf056-2af7-4b0f-9a42-e33b991a72e4 service nova] Acquiring lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-26dc349c-5ab4-47af-a36a-530da68ea843 req-aacbf056-2af7-4b0f-9a42-e33b991a72e4 service nova] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-26dc349c-5ab4-47af-a36a-530da68ea843 req-aacbf056-2af7-4b0f-9a42-e33b991a72e4 service nova] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-26dc349c-5ab4-47af-a36a-530da68ea843 req-aacbf056-2af7-4b0f-9a42-e33b991a72e4 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] No waiting events found dispatching network-vif-plugged-721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:29:59 user nova-compute[73520]: WARNING nova.compute.manager [req-26dc349c-5ab4-47af-a36a-530da68ea843 req-aacbf056-2af7-4b0f-9a42-e33b991a72e4 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Received unexpected event network-vif-plugged-721a7b26-4adf-4711-b0df-6842b589bb78 for instance with vm_state building and task_state spawning.
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188999.4323976, 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:29:59 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] VM Resumed (Lifecycle Event)
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:29:59 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Instance spawned successfully.
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:29:59 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692188999.4360585, 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:29:59 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] VM Started (Lifecycle Event)
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:29:59 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:29:59 user nova-compute[73520]: INFO nova.compute.manager [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Took 6.22 seconds to spawn the instance on the hypervisor.
Aug 16 12:29:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:29:59 user nova-compute[73520]: INFO nova.compute.manager [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Took 7.22 seconds to build instance.
Aug 16 12:29:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-56cffefd-2137-4845-8260-76da49ddace3 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.357s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-af017681-f0da-429c-b3b0-632c46a70f95 req-af08e961-8145-46d2-8b11-b7a8a8ae5951 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received event network-changed-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-af017681-f0da-429c-b3b0-632c46a70f95 req-af08e961-8145-46d2-8b11-b7a8a8ae5951 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Refreshing instance network info cache due to event network-changed-c69bc36b-7b76-485b-8230-adefec403ef4. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:30:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-af017681-f0da-429c-b3b0-632c46a70f95 req-af08e961-8145-46d2-8b11-b7a8a8ae5951 service nova] Acquiring lock "refresh_cache-27a51073-9874-453e-b550-5365fa5917eb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:30:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-af017681-f0da-429c-b3b0-632c46a70f95 req-af08e961-8145-46d2-8b11-b7a8a8ae5951 service nova] Acquired lock "refresh_cache-27a51073-9874-453e-b550-5365fa5917eb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:30:05 user nova-compute[73520]: DEBUG nova.network.neutron [req-af017681-f0da-429c-b3b0-632c46a70f95 req-af08e961-8145-46d2-8b11-b7a8a8ae5951 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Refreshing network info cache for port c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG nova.network.neutron [req-af017681-f0da-429c-b3b0-632c46a70f95 req-af08e961-8145-46d2-8b11-b7a8a8ae5951 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Updated VIF entry in instance network info cache for port c69bc36b-7b76-485b-8230-adefec403ef4. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG nova.network.neutron [req-af017681-f0da-429c-b3b0-632c46a70f95 req-af08e961-8145-46d2-8b11-b7a8a8ae5951 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Updating instance_info_cache with network_info: [{"id": "c69bc36b-7b76-485b-8230-adefec403ef4", "address": "fa:16:3e:0b:0b:a7", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69bc36b-7b", "ovs_interfaceid": "c69bc36b-7b76-485b-8230-adefec403ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-af017681-f0da-429c-b3b0-632c46a70f95 req-af08e961-8145-46d2-8b11-b7a8a8ae5951 service nova] Releasing lock "refresh_cache-27a51073-9874-453e-b550-5365fa5917eb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "27a51073-9874-453e-b550-5365fa5917eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "27a51073-9874-453e-b550-5365fa5917eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "27a51073-9874-453e-b550-5365fa5917eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:06 user nova-compute[73520]: INFO nova.compute.manager [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Terminating instance
Aug 16 12:30:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG nova.compute.manager [req-b74d1c84-394f-4d34-9a16-d24e35762d18 req-f53d66e6-aaec-473a-8a0a-02c7990210bd service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received event network-vif-unplugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b74d1c84-394f-4d34-9a16-d24e35762d18 req-f53d66e6-aaec-473a-8a0a-02c7990210bd service nova] Acquiring lock "27a51073-9874-453e-b550-5365fa5917eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b74d1c84-394f-4d34-9a16-d24e35762d18 req-f53d66e6-aaec-473a-8a0a-02c7990210bd service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b74d1c84-394f-4d34-9a16-d24e35762d18 req-f53d66e6-aaec-473a-8a0a-02c7990210bd service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG nova.compute.manager [req-b74d1c84-394f-4d34-9a16-d24e35762d18 req-f53d66e6-aaec-473a-8a0a-02c7990210bd service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] No waiting events found dispatching network-vif-unplugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:06 user nova-compute[73520]: DEBUG nova.compute.manager [req-b74d1c84-394f-4d34-9a16-d24e35762d18 req-f53d66e6-aaec-473a-8a0a-02c7990210bd service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received event network-vif-unplugged-c69bc36b-7b76-485b-8230-adefec403ef4 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:07 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Instance destroyed successfully.
Aug 16 12:30:07 user nova-compute[73520]: DEBUG nova.objects.instance [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lazy-loading 'resources' on Instance uuid 27a51073-9874-453e-b550-5365fa5917eb {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1528404402',display_name='tempest-TestVolumeBootPattern-server-1528404402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1528404402',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJr/o6vrVZnxmYhfYixlxoifuhCtvsj5vKkg3ZAc0JSOeGoo3PmY57Yx5t3KGcWwXVP9aD5zqccktnbo7190qT8/kMlT5jQNhZVEjx4vkSe9H5//tD72sKPKPHQkEbRmQ==',key_name='tempest-TestVolumeBootPattern-586845281',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:28:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-jdnrba1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:28:30Z,user_data=None,user_id='17ed1823b0de433ab523470e235fdd72',uuid=27a51073-9874-453e-b550-5365fa5917eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c69bc36b-7b76-485b-8230-adefec403ef4", "address": "fa:16:3e:0b:0b:a7", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69bc36b-7b", "ovs_interfaceid": "c69bc36b-7b76-485b-8230-adefec403ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "c69bc36b-7b76-485b-8230-adefec403ef4", "address": "fa:16:3e:0b:0b:a7", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69bc36b-7b", "ovs_interfaceid": "c69bc36b-7b76-485b-8230-adefec403ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:0b:a7,bridge_name='br-int',has_traffic_filtering=True,id=c69bc36b-7b76-485b-8230-adefec403ef4,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69bc36b-7b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_vif [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:0b:a7,bridge_name='br-int',has_traffic_filtering=True,id=c69bc36b-7b76-485b-8230-adefec403ef4,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69bc36b-7b') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc69bc36b-7b, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:07 user nova-compute[73520]: INFO os_vif [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:0b:a7,bridge_name='br-int',has_traffic_filtering=True,id=c69bc36b-7b76-485b-8230-adefec403ef4,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69bc36b-7b')
Aug 16 12:30:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqXJxpaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:30:07 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c5e153-7ce9-4ff5-bfa3-9306ec4ca579]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e30e20-6711-4c3d-b550-0aebf8d6a034]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:30:07 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:30:07 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:30:07 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:30:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:30:07 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:30:07 user nova-compute[73520]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:30:07 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:30:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c4dedd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d'): ({'sdd'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Removing single pathed devices sdd {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7133a8c-9f13-49cb-a895-e9f02bbe430f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.048s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e56ce12-dad1-4ddf-990f-8d91187e5809]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flushing IO for device /dev/sdd {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[970ec4e0-7c8c-43a0-ac6a-32705d765dad]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[299cd9ad-cff9-4687-9286-6a1a16881c68]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] SCSI volumes sdd have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[12507be1-5c70-4d7c-a939-5ffa29328a90]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb591609-4032-422b-ac84-e50879a9c367]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260]
Aug 16 12:30:07 user nova-compute[73520]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260] successful.
Aug 16 12:30:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[58993258-a9e5-4e6a-9a9a-ca92645b555b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== disconnect_volume: return (385ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:30:07 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Deleting instance files /opt/stack/data/nova/instances/27a51073-9874-453e-b550-5365fa5917eb_del
Aug 16 12:30:07 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Deletion of /opt/stack/data/nova/instances/27a51073-9874-453e-b550-5365fa5917eb_del complete
Aug 16 12:30:07 user nova-compute[73520]: INFO nova.compute.manager [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Took 1.36 seconds to destroy the instance on the hypervisor.
Aug 16 12:30:07 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:30:07 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 27a51073-9874-453e-b550-5365fa5917eb] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received event network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Acquiring lock "27a51073-9874-453e-b550-5365fa5917eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] No waiting events found dispatching network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:08 user nova-compute[73520]: WARNING nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received unexpected event network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 for instance with vm_state active and task_state deleting.
Aug 16 12:30:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received event network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Acquiring lock "27a51073-9874-453e-b550-5365fa5917eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] No waiting events found dispatching network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:08 user nova-compute[73520]: WARNING nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received unexpected event network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 for instance with vm_state active and task_state deleting.
Aug 16 12:30:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received event network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Acquiring lock "27a51073-9874-453e-b550-5365fa5917eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] No waiting events found dispatching network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:08 user nova-compute[73520]: WARNING nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received unexpected event network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 for instance with vm_state active and task_state deleting.
Aug 16 12:30:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received event network-vif-unplugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Acquiring lock "27a51073-9874-453e-b550-5365fa5917eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] No waiting events found dispatching network-vif-unplugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received event network-vif-unplugged-c69bc36b-7b76-485b-8230-adefec403ef4 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received event network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Acquiring lock "27a51073-9874-453e-b550-5365fa5917eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] Lock "27a51073-9874-453e-b550-5365fa5917eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] No waiting events found dispatching network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:09 user nova-compute[73520]: WARNING nova.compute.manager [req-5ba7675d-714a-4bd4-ba80-bd38c7f1cc4b req-f311b6ea-c25f-4f32-8426-6304ea8a5546 service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received unexpected event network-vif-plugged-c69bc36b-7b76-485b-8230-adefec403ef4 for instance with vm_state active and task_state deleting.
Aug 16 12:30:09 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:30:09 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Took 1.18 seconds to deallocate network for instance.
Aug 16 12:30:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-35cbe439-df26-482d-8a1c-8abba8ad7075 req-1756148c-7b68-49e2-8fe2-ab5fddafff9d service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Received event network-vif-deleted-c69bc36b-7b76-485b-8230-adefec403ef4 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:09 user nova-compute[73520]: INFO nova.compute.manager [req-35cbe439-df26-482d-8a1c-8abba8ad7075 req-1756148c-7b68-49e2-8fe2-ab5fddafff9d service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Neutron deleted interface c69bc36b-7b76-485b-8230-adefec403ef4; detaching it from the instance and deleting it from the info cache
Aug 16 12:30:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-35cbe439-df26-482d-8a1c-8abba8ad7075 req-1756148c-7b68-49e2-8fe2-ab5fddafff9d service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:30:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-35cbe439-df26-482d-8a1c-8abba8ad7075 req-1756148c-7b68-49e2-8fe2-ab5fddafff9d service nova] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Detach interface failed, port_id=c69bc36b-7b76-485b-8230-adefec403ef4, reason: Instance 27a51073-9874-453e-b550-5365fa5917eb could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:30:10 user nova-compute[73520]: INFO nova.compute.manager [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Took 0.85 seconds to detach 1 volumes for instance.
Aug 16 12:30:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "25b02048-2937-440a-9809-eceeb3558856" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:30:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:10 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:30:10 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:30:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.289s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:10 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:30:10 user nova-compute[73520]: INFO nova.compute.claims [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Claim successful on node user
Aug 16 12:30:10 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Deleted allocations for instance 27a51073-9874-453e-b550-5365fa5917eb
Aug 16 12:30:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-552d426d-114f-493a-a73f-6975b762da3e tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "27a51073-9874-453e-b550-5365fa5917eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.085s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:10 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:30:10 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG nova.network.neutron [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:30:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:30:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG nova.policy [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d351d0adad3463ebb2e6917a5f91920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930fb7964e2942c88c3416be172c6884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:30:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Creating image(s)
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "/opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "/opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "/opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk 1073741824" returned: 0 in 0.068s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:11 user nova-compute[73520]: DEBUG nova.network.neutron [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Successfully created port: 53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:30:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:12 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Cannot resize image /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:30:12 user nova-compute[73520]: DEBUG nova.objects.instance [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'migration_context' on Instance uuid 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:30:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:30:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Ensure instance console log exists: /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:30:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.network.neutron [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Successfully updated port: 53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquired lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.network.neutron [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-81aafa91-5ab1-4f7f-bef4-31e180728810 req-1b120f53-f365-4025-be70-81ba5005387a service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-changed-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-81aafa91-5ab1-4f7f-bef4-31e180728810 req-1b120f53-f365-4025-be70-81ba5005387a service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Refreshing instance network info cache due to event network-changed-53e90722-ef5f-49c8-b2b9-09ecaa2667d8. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-81aafa91-5ab1-4f7f-bef4-31e180728810 req-1b120f53-f365-4025-be70-81ba5005387a service nova] Acquiring lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.network.neutron [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.network.neutron [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Updating instance_info_cache with network_info: [{"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Releasing lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Instance network_info: |[{"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-81aafa91-5ab1-4f7f-bef4-31e180728810 req-1b120f53-f365-4025-be70-81ba5005387a service nova] Acquired lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.network.neutron [req-81aafa91-5ab1-4f7f-bef4-31e180728810 req-1b120f53-f365-4025-be70-81ba5005387a service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Refreshing network info cache for port 53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Start _get_guest_xml network_info=[{"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "52275f84-b38b-4351-befe-9052b1e02612" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:13 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:30:13 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1961434269',display_name='tempest-ServerRescueNegativeTestJSON-server-1961434269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1961434269',id=38,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/RNXMMAE6Nph8fr40EWI8DA2vqJl1a7Tx5xgfI37ZS3iKYbKFVFDMfz8BRbL3rjE3RFbrWS1JU5JZI5jkyrlHh+n7SlBJyNgsnXpezEuggqqGA9pismjrTTMnP74Mvdw==',key_name='tempest-keypair-1410904948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930fb7964e2942c88c3416be172c6884',ramdisk_id='',reservation_id='r-27j4rxm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-863509458',owner_user_name='tempest-ServerRescueNegativeTestJSON-863509458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d351d0adad3463ebb2e6917a5f91920',uuid=25b02048-2937-440a-9809-eceeb3558856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converting VIF {"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:90,bridge_name='br-int',has_traffic_filtering=True,id=53e90722-ef5f-49c8-b2b9-09ecaa2667d8,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e90722-ef') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.objects.instance [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'pci_devices' on Instance uuid 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:30:13 user nova-compute[73520]:   <uuid>25b02048-2937-440a-9809-eceeb3558856</uuid>
Aug 16 12:30:13 user nova-compute[73520]:   <name>instance-00000026</name>
Aug 16 12:30:13 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:30:13 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:30:13 user nova-compute[73520]:   <metadata>
Aug 16 12:30:13 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:30:13 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:30:13 user nova-compute[73520]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1961434269</nova:name>
Aug 16 12:30:13 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:30:13</nova:creationTime>
Aug 16 12:30:13 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:30:13 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:30:13 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:30:13 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:30:13 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:30:13 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:30:13 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:30:13 user nova-compute[73520]:       <nova:owner>
Aug 16 12:30:13 user nova-compute[73520]:         <nova:user uuid="0d351d0adad3463ebb2e6917a5f91920">tempest-ServerRescueNegativeTestJSON-863509458-project-member</nova:user>
Aug 16 12:30:13 user nova-compute[73520]:         <nova:project uuid="930fb7964e2942c88c3416be172c6884">tempest-ServerRescueNegativeTestJSON-863509458</nova:project>
Aug 16 12:30:13 user nova-compute[73520]:       </nova:owner>
Aug 16 12:30:13 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:30:13 user nova-compute[73520]:       <nova:ports>
Aug 16 12:30:13 user nova-compute[73520]:         <nova:port uuid="53e90722-ef5f-49c8-b2b9-09ecaa2667d8">
Aug 16 12:30:13 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 12:30:13 user nova-compute[73520]:         </nova:port>
Aug 16 12:30:13 user nova-compute[73520]:       </nova:ports>
Aug 16 12:30:13 user nova-compute[73520]:     </nova:instance>
Aug 16 12:30:13 user nova-compute[73520]:   </metadata>
Aug 16 12:30:13 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:30:13 user nova-compute[73520]:     <system>
Aug 16 12:30:13 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:30:13 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:30:13 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:30:13 user nova-compute[73520]:       <entry name="serial">25b02048-2937-440a-9809-eceeb3558856</entry>
Aug 16 12:30:13 user nova-compute[73520]:       <entry name="uuid">25b02048-2937-440a-9809-eceeb3558856</entry>
Aug 16 12:30:13 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:30:13 user nova-compute[73520]:     </system>
Aug 16 12:30:13 user nova-compute[73520]:   </sysinfo>
Aug 16 12:30:13 user nova-compute[73520]:   <os>
Aug 16 12:30:13 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:30:13 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:30:13 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:30:13 user nova-compute[73520]:   </os>
Aug 16 12:30:13 user nova-compute[73520]:   <features>
Aug 16 12:30:13 user nova-compute[73520]:     <acpi/>
Aug 16 12:30:13 user nova-compute[73520]:     <apic/>
Aug 16 12:30:13 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:30:13 user nova-compute[73520]:   </features>
Aug 16 12:30:13 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:30:13 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:30:13 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:30:13 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:30:13 user nova-compute[73520]:   </clock>
Aug 16 12:30:13 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:30:13 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:30:13 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:30:13 user nova-compute[73520]:   </cpu>
Aug 16 12:30:13 user nova-compute[73520]:   <devices>
Aug 16 12:30:13 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:30:13 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:30:13 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk"/>
Aug 16 12:30:13 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:30:13 user nova-compute[73520]:     </disk>
Aug 16 12:30:13 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:30:13 user nova-compute[73520]:       <mac address="fa:16:3e:c2:11:90"/>
Aug 16 12:30:13 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:30:13 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:30:13 user nova-compute[73520]:       <target dev="tap53e90722-ef"/>
Aug 16 12:30:13 user nova-compute[73520]:     </interface>
Aug 16 12:30:13 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:30:13 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/console.log" append="off"/>
Aug 16 12:30:13 user nova-compute[73520]:     </serial>
Aug 16 12:30:13 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:30:13 user nova-compute[73520]:     <video>
Aug 16 12:30:13 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:30:13 user nova-compute[73520]:     </video>
Aug 16 12:30:13 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:30:13 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:30:13 user nova-compute[73520]:     </rng>
Aug 16 12:30:13 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:30:13 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:30:13 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:30:13 user nova-compute[73520]:     </memballoon>
Aug 16 12:30:13 user nova-compute[73520]:   </devices>
Aug 16 12:30:13 user nova-compute[73520]: </domain>
Aug 16 12:30:13 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1961434269',display_name='tempest-ServerRescueNegativeTestJSON-server-1961434269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1961434269',id=38,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/RNXMMAE6Nph8fr40EWI8DA2vqJl1a7Tx5xgfI37ZS3iKYbKFVFDMfz8BRbL3rjE3RFbrWS1JU5JZI5jkyrlHh+n7SlBJyNgsnXpezEuggqqGA9pismjrTTMnP74Mvdw==',key_name='tempest-keypair-1410904948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='930fb7964e2942c88c3416be172c6884',ramdisk_id='',reservation_id='r-27j4rxm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-863509458',owner_user_name='tempest-ServerRescueNegativeTestJSON-863509458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d351d0adad3463ebb2e6917a5f91920',uuid=25b02048-2937-440a-9809-eceeb3558856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converting VIF {"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:90,bridge_name='br-int',has_traffic_filtering=True,id=53e90722-ef5f-49c8-b2b9-09ecaa2667d8,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e90722-ef') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG os_vif [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:90,bridge_name='br-int',has_traffic_filtering=True,id=53e90722-ef5f-49c8-b2b9-09ecaa2667d8,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e90722-ef') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53e90722-ef, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53e90722-ef, col_values=(('external_ids', {'iface-id': '53e90722-ef5f-49c8-b2b9-09ecaa2667d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:11:90', 'vm-uuid': '25b02048-2937-440a-9809-eceeb3558856'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:13 user nova-compute[73520]: INFO os_vif [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:90,bridge_name='br-int',has_traffic_filtering=True,id=53e90722-ef5f-49c8-b2b9-09ecaa2667d8,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e90722-ef')
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No VIF found with MAC fa:16:3e:c2:11:90, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:14 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:30:14 user nova-compute[73520]: INFO nova.compute.claims [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Claim successful on node user
Aug 16 12:30:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-81aafa91-5ab1-4f7f-bef4-31e180728810 req-1b120f53-f365-4025-be70-81ba5005387a service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Updated VIF entry in instance network info cache for port 53e90722-ef5f-49c8-b2b9-09ecaa2667d8. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:30:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-81aafa91-5ab1-4f7f-bef4-31e180728810 req-1b120f53-f365-4025-be70-81ba5005387a service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Updating instance_info_cache with network_info: [{"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:30:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-81aafa91-5ab1-4f7f-bef4-31e180728810 req-1b120f53-f365-4025-be70-81ba5005387a service nova] Releasing lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:30:14 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:30:14 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:30:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.843s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:30:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:30:14 user nova-compute[73520]: DEBUG nova.network.neutron [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:30:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:30:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:30:14 user nova-compute[73520]: DEBUG nova.policy [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d1e9417253f43b482e8ee5b3109a697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3756b80f2243dca0b31ffea7438b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:30:15 user nova-compute[73520]: INFO nova.virt.block_device [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Booting with volume-backed-image ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe at /dev/vda
Aug 16 12:30:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:15 user nova-compute[73520]: DEBUG nova.network.neutron [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Successfully created port: 614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:30:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-a61862d4-87f5-44a7-90e8-52cc810080bc req-1f6173b0-087f-4549-977a-2e81b189587f service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a61862d4-87f5-44a7-90e8-52cc810080bc req-1f6173b0-087f-4549-977a-2e81b189587f service nova] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a61862d4-87f5-44a7-90e8-52cc810080bc req-1f6173b0-087f-4549-977a-2e81b189587f service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a61862d4-87f5-44a7-90e8-52cc810080bc req-1f6173b0-087f-4549-977a-2e81b189587f service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-a61862d4-87f5-44a7-90e8-52cc810080bc req-1f6173b0-087f-4549-977a-2e81b189587f service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] No waiting events found dispatching network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:15 user nova-compute[73520]: WARNING nova.compute.manager [req-a61862d4-87f5-44a7-90e8-52cc810080bc req-1f6173b0-087f-4549-977a-2e81b189587f service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received unexpected event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 for instance with vm_state building and task_state spawning.
Aug 16 12:30:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Successfully updated port: 614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:30:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "refresh_cache-52275f84-b38b-4351-befe-9052b1e02612" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:30:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquired lock "refresh_cache-52275f84-b38b-4351-befe-9052b1e02612" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:30:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-80d87542-2d34-44a1-923f-e90f10d3cd0a req-85532cd4-52cc-46d7-8a2c-f6828e3a0585 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-changed-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-80d87542-2d34-44a1-923f-e90f10d3cd0a req-85532cd4-52cc-46d7-8a2c-f6828e3a0585 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Refreshing instance network info cache due to event network-changed-614067cd-fd42-4bc4-8707-742fde3c1b05. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-80d87542-2d34-44a1-923f-e90f10d3cd0a req-85532cd4-52cc-46d7-8a2c-f6828e3a0585 service nova] Acquiring lock "refresh_cache-52275f84-b38b-4351-befe-9052b1e02612" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Updating instance_info_cache with network_info: [{"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Releasing lock "refresh_cache-52275f84-b38b-4351-befe-9052b1e02612" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Instance network_info: |[{"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-80d87542-2d34-44a1-923f-e90f10d3cd0a req-85532cd4-52cc-46d7-8a2c-f6828e3a0585 service nova] Acquired lock "refresh_cache-52275f84-b38b-4351-befe-9052b1e02612" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG nova.network.neutron [req-80d87542-2d34-44a1-923f-e90f10d3cd0a req-85532cd4-52cc-46d7-8a2c-f6828e3a0585 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Refreshing network info cache for port 614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-0943c2bb-3ba3-4b0c-9988-4dc54e9582e0 req-a84279fc-d10c-4aab-9301-e6668dc8daa8 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0943c2bb-3ba3-4b0c-9988-4dc54e9582e0 req-a84279fc-d10c-4aab-9301-e6668dc8daa8 service nova] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0943c2bb-3ba3-4b0c-9988-4dc54e9582e0 req-a84279fc-d10c-4aab-9301-e6668dc8daa8 service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0943c2bb-3ba3-4b0c-9988-4dc54e9582e0 req-a84279fc-d10c-4aab-9301-e6668dc8daa8 service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-0943c2bb-3ba3-4b0c-9988-4dc54e9582e0 req-a84279fc-d10c-4aab-9301-e6668dc8daa8 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] No waiting events found dispatching network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:17 user nova-compute[73520]: WARNING nova.compute.manager [req-0943c2bb-3ba3-4b0c-9988-4dc54e9582e0 req-a84279fc-d10c-4aab-9301-e6668dc8daa8 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received unexpected event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 for instance with vm_state building and task_state spawning.
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189018.1065483, 25b02048-2937-440a-9809-eceeb3558856 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:30:18 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] VM Resumed (Lifecycle Event)
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:30:18 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 25b02048-2937-440a-9809-eceeb3558856] Instance spawned successfully.
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:18 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189018.1103957, 25b02048-2937-440a-9809-eceeb3558856 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:30:18 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] VM Started (Lifecycle Event)
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:30:18 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:30:18 user nova-compute[73520]: INFO nova.compute.manager [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Took 7.00 seconds to spawn the instance on the hypervisor.
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:30:18 user nova-compute[73520]: INFO nova.compute.manager [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Took 8.15 seconds to build instance.
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.network.neutron [req-80d87542-2d34-44a1-923f-e90f10d3cd0a req-85532cd4-52cc-46d7-8a2c-f6828e3a0585 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Updated VIF entry in instance network info cache for port 614067cd-fd42-4bc4-8707-742fde3c1b05. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG nova.network.neutron [req-80d87542-2d34-44a1-923f-e90f10d3cd0a req-85532cd4-52cc-46d7-8a2c-f6828e3a0585 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Updating instance_info_cache with network_info: [{"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-80d87542-2d34-44a1-923f-e90f10d3cd0a req-85532cd4-52cc-46d7-8a2c-f6828e3a0585 service nova] Releasing lock "refresh_cache-52275f84-b38b-4351-befe-9052b1e02612" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71fe6d30-3e02-4223-91e7-1b810e4afe53 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "25b02048-2937-440a-9809-eceeb3558856" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.266s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:22 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189007.3892512, 27a51073-9874-453e-b550-5365fa5917eb => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:30:22 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 27a51073-9874-453e-b550-5365fa5917eb] VM Stopped (Lifecycle Event)
Aug 16 12:30:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-25a6b02c-c176-4346-bd38-3623291d8b78 None None] [instance: 27a51073-9874-453e-b550-5365fa5917eb] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:30:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG os_brick.utils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab731bd-1a45-454c-b9fa-3d26e6227076]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b52f69-b69d-4b06-be9f-254532137492]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5a4556-ca01-4e79-aec6-e0196f10385b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e07150-935c-4795-9945-e7781c2bc87d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:30:26 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:30:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[48230358-cbcd-4c44-8458-7f94afb3719f]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG os_brick.utils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Updating existing volume attachment record: 9cfc4377-c497-4b5f-b2da-ae7e86fa7fda {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:30:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:28 user nova-compute[73520]: INFO nova.compute.manager [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Terminating instance
Aug 16 12:30:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-bab9c5df-7b66-41e7-80f8-e0d278259ab0 req-c1aa2d2e-ad3a-45d4-a33c-01b732bef83d service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received event network-vif-unplugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bab9c5df-7b66-41e7-80f8-e0d278259ab0 req-c1aa2d2e-ad3a-45d4-a33c-01b732bef83d service nova] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bab9c5df-7b66-41e7-80f8-e0d278259ab0 req-c1aa2d2e-ad3a-45d4-a33c-01b732bef83d service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bab9c5df-7b66-41e7-80f8-e0d278259ab0 req-c1aa2d2e-ad3a-45d4-a33c-01b732bef83d service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-bab9c5df-7b66-41e7-80f8-e0d278259ab0 req-c1aa2d2e-ad3a-45d4-a33c-01b732bef83d service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] No waiting events found dispatching network-vif-unplugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-bab9c5df-7b66-41e7-80f8-e0d278259ab0 req-c1aa2d2e-ad3a-45d4-a33c-01b732bef83d service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received event network-vif-unplugged-e230cf5f-ff43-476e-b808-41f0c3f11963 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:28 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Instance destroyed successfully.
Aug 16 12:30:28 user nova-compute[73520]: DEBUG nova.objects.instance [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lazy-loading 'resources' on Instance uuid 61633714-d25e-4cde-b757-b3c3f6fd8d71 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1180361508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1180361508',id=33,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfkEYZLGDx6EYezKN4oK9B9wCW5phyLrCizSqon9tcojC71hDzlZRPIPlCl3qnE+Uq7R7KhXw33/MHXWNmk8GveZToBVft7dR+WRJyJmNOWzjTlp/G3pP44YVDI8bKFtg==',key_name='tempest-keypair-1175824880',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:28:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed29e455a840474b8a1407af538883ab',ramdisk_id='',reservation_id='r-70vxdm7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-974908846',owner_user_name='tempest-AttachVolumeShelveTestJSON-974908846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:28:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7e48ee408e24af083b40b19437cfbac',uuid=61633714-d25e-4cde-b757-b3c3f6fd8d71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converting VIF {"id": "e230cf5f-ff43-476e-b808-41f0c3f11963", "address": "fa:16:3e:6b:ec:94", "network": {"id": "53b9550d-c556-4a1d-910b-772b16b346cf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-767749303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed29e455a840474b8a1407af538883ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape230cf5f-ff", "ovs_interfaceid": "e230cf5f-ff43-476e-b808-41f0c3f11963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG os_vif [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape230cf5f-ff, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:30:28 user nova-compute[73520]: INFO os_vif [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ec:94,bridge_name='br-int',has_traffic_filtering=True,id=e230cf5f-ff43-476e-b808-41f0c3f11963,network=Network(53b9550d-c556-4a1d-910b-772b16b346cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape230cf5f-ff')
Aug 16 12:30:28 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Deleting instance files /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71_del
Aug 16 12:30:28 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Deletion of /opt/stack/data/nova/instances/61633714-d25e-4cde-b757-b3c3f6fd8d71_del complete
Aug 16 12:30:29 user nova-compute[73520]: INFO nova.compute.manager [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Took 0.76 seconds to destroy the instance on the hypervisor.
Aug 16 12:30:29 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:30:29 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:30:29 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:30:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:29 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:30:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-32a416c2-4f93-4272-a349-7d30e41a005e req-e1d2dc6d-3c68-4bf3-82aa-77fd399a826c service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received event network-vif-deleted-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:29 user nova-compute[73520]: INFO nova.compute.manager [req-32a416c2-4f93-4272-a349-7d30e41a005e req-e1d2dc6d-3c68-4bf3-82aa-77fd399a826c service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Neutron deleted interface e230cf5f-ff43-476e-b808-41f0c3f11963; detaching it from the instance and deleting it from the info cache
Aug 16 12:30:29 user nova-compute[73520]: DEBUG nova.network.neutron [req-32a416c2-4f93-4272-a349-7d30e41a005e req-e1d2dc6d-3c68-4bf3-82aa-77fd399a826c service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:30:29 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Took 0.93 seconds to deallocate network for instance.
Aug 16 12:30:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-32a416c2-4f93-4272-a349-7d30e41a005e req-e1d2dc6d-3c68-4bf3-82aa-77fd399a826c service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Detach interface failed, port_id=e230cf5f-ff43-476e-b808-41f0c3f11963, reason: Instance 61633714-d25e-4cde-b757-b3c3f6fd8d71 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:30:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:30 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:30:30 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:30:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:30 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Deleted allocations for instance 61633714-d25e-4cde-b757-b3c3f6fd8d71
Aug 16 12:30:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-74dbc3dd-a388-4bd6-b2c0-57db9763c36b tempest-AttachVolumeShelveTestJSON-974908846 tempest-AttachVolumeShelveTestJSON-974908846-project-member] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.303s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-212bb407-7577-4b63-915e-a32edc153dd6 req-4eaf6128-6a90-45c4-8a7f-c450ea0c2132 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received event network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-212bb407-7577-4b63-915e-a32edc153dd6 req-4eaf6128-6a90-45c4-8a7f-c450ea0c2132 service nova] Acquiring lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-212bb407-7577-4b63-915e-a32edc153dd6 req-4eaf6128-6a90-45c4-8a7f-c450ea0c2132 service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-212bb407-7577-4b63-915e-a32edc153dd6 req-4eaf6128-6a90-45c4-8a7f-c450ea0c2132 service nova] Lock "61633714-d25e-4cde-b757-b3c3f6fd8d71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-212bb407-7577-4b63-915e-a32edc153dd6 req-4eaf6128-6a90-45c4-8a7f-c450ea0c2132 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] No waiting events found dispatching network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:30 user nova-compute[73520]: WARNING nova.compute.manager [req-212bb407-7577-4b63-915e-a32edc153dd6 req-4eaf6128-6a90-45c4-8a7f-c450ea0c2132 service nova] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Received unexpected event network-vif-plugged-e230cf5f-ff43-476e-b808-41f0c3f11963 for instance with vm_state deleted and task_state None.
Aug 16 12:30:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:30:37 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Creating image(s)
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Ensure instance console log exists: /opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Start _get_guest_xml network_info=[{"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuiMDjbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '52275f84-b38b-4351-befe-9052b1e02612', 'attached_at': '', 'detached_at': '', 'volume_id': '2c685011-7645-408a-97f7-cc9c4eb58585', 'serial': '2c685011-7645-408a-97f7-cc9c4eb58585'}, 'attachment_id': '9cfc4377-c497-4b5f-b2da-ae7e86fa7fda', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:30:37 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:30:37 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuiMDjbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:30:37 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:30:37 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:30:37 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9315ab-2584-4297-a480-08d9824e4a8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:30:37 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c183f923-3de2-41c9-ae4e-ed372f4f9993]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585] added
Aug 16 12:30:37 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d9f268-35a3-42b7-8512-f5b50f2c2d7a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20ec66b-54ce-477a-9049-ab4d12ba2057]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuiMDjbF {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuiMDjbF" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cea7ca-6bde-48a7-ac34-8b4b898f9d66]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VuiMDjbF'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf91f87-5898-4fa7-a9d3-55e69fa1f696]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3253553f-c5f9-4a28-bfa9-3ec625838537]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:30:37 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:30:37 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:30:37 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:30:37 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:30:37 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:30:37 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[194d87bc-e704-4ebc-9367-cb5354b24590]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585, portal: 172.16.0.220,3260]
Aug 16 12:30:37 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585, portal: 172.16.0.220,3260] successful.
Aug 16 12:30:37 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a819ec-2d7e-43de-9cc8-2bd0ef996643]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e0634b-fbc3-4644-92a3-528941cb5bf0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:30:37 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:30:37 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:30:37 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:30:37 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:30:37 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:30:37 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:30:37 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:30:37 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bedf2f-5646-4fd2-bd2c-d4dd8ab08fe6]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:30:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuiMDjbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26662323132353363', 'path': '/dev/sdd'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662323132353363', 'path': '/dev/sdd'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1383144430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1383144430',id=39,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-6nnhz2wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:30:15Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=52275f84-b38b-4351-befe-9052b1e02612,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:9f,bridge_name='br-int',has_traffic_filtering=True,id=614067cd-fd42-4bc4-8707-742fde3c1b05,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614067cd-fd') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG nova.objects.instance [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'pci_devices' on Instance uuid 52275f84-b38b-4351-befe-9052b1e02612 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:30:38 user nova-compute[73520]:   <uuid>52275f84-b38b-4351-befe-9052b1e02612</uuid>
Aug 16 12:30:38 user nova-compute[73520]:   <name>instance-00000027</name>
Aug 16 12:30:38 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:30:38 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:30:38 user nova-compute[73520]:   <metadata>
Aug 16 12:30:38 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:30:38 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:30:38 user nova-compute[73520]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1383144430</nova:name>
Aug 16 12:30:38 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:30:37</nova:creationTime>
Aug 16 12:30:38 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:30:38 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:30:38 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:30:38 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:30:38 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:30:38 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:30:38 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:30:38 user nova-compute[73520]:       <nova:owner>
Aug 16 12:30:38 user nova-compute[73520]:         <nova:user uuid="3d1e9417253f43b482e8ee5b3109a697">tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member</nova:user>
Aug 16 12:30:38 user nova-compute[73520]:         <nova:project uuid="4d3756b80f2243dca0b31ffea7438b5d">tempest-ServerBootFromVolumeStableRescueTest-1104312883</nova:project>
Aug 16 12:30:38 user nova-compute[73520]:       </nova:owner>
Aug 16 12:30:38 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:30:38 user nova-compute[73520]:       <nova:ports>
Aug 16 12:30:38 user nova-compute[73520]:         <nova:port uuid="614067cd-fd42-4bc4-8707-742fde3c1b05">
Aug 16 12:30:38 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 12:30:38 user nova-compute[73520]:         </nova:port>
Aug 16 12:30:38 user nova-compute[73520]:       </nova:ports>
Aug 16 12:30:38 user nova-compute[73520]:     </nova:instance>
Aug 16 12:30:38 user nova-compute[73520]:   </metadata>
Aug 16 12:30:38 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:30:38 user nova-compute[73520]:     <system>
Aug 16 12:30:38 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:30:38 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:30:38 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:30:38 user nova-compute[73520]:       <entry name="serial">52275f84-b38b-4351-befe-9052b1e02612</entry>
Aug 16 12:30:38 user nova-compute[73520]:       <entry name="uuid">52275f84-b38b-4351-befe-9052b1e02612</entry>
Aug 16 12:30:38 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:30:38 user nova-compute[73520]:     </system>
Aug 16 12:30:38 user nova-compute[73520]:   </sysinfo>
Aug 16 12:30:38 user nova-compute[73520]:   <os>
Aug 16 12:30:38 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:30:38 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:30:38 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:30:38 user nova-compute[73520]:   </os>
Aug 16 12:30:38 user nova-compute[73520]:   <features>
Aug 16 12:30:38 user nova-compute[73520]:     <acpi/>
Aug 16 12:30:38 user nova-compute[73520]:     <apic/>
Aug 16 12:30:38 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:30:38 user nova-compute[73520]:   </features>
Aug 16 12:30:38 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:30:38 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:30:38 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:30:38 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:30:38 user nova-compute[73520]:   </clock>
Aug 16 12:30:38 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:30:38 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:30:38 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:30:38 user nova-compute[73520]:   </cpu>
Aug 16 12:30:38 user nova-compute[73520]:   <devices>
Aug 16 12:30:38 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:30:38 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:30:38 user nova-compute[73520]:       <source dev="/dev/sdd"/>
Aug 16 12:30:38 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:30:38 user nova-compute[73520]:       <serial>2c685011-7645-408a-97f7-cc9c4eb58585</serial>
Aug 16 12:30:38 user nova-compute[73520]:     </disk>
Aug 16 12:30:38 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:30:38 user nova-compute[73520]:       <mac address="fa:16:3e:34:5b:9f"/>
Aug 16 12:30:38 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:30:38 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:30:38 user nova-compute[73520]:       <target dev="tap614067cd-fd"/>
Aug 16 12:30:38 user nova-compute[73520]:     </interface>
Aug 16 12:30:38 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:30:38 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/console.log" append="off"/>
Aug 16 12:30:38 user nova-compute[73520]:     </serial>
Aug 16 12:30:38 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:30:38 user nova-compute[73520]:     <video>
Aug 16 12:30:38 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:30:38 user nova-compute[73520]:     </video>
Aug 16 12:30:38 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:30:38 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:30:38 user nova-compute[73520]:     </rng>
Aug 16 12:30:38 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:30:38 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:30:38 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:30:38 user nova-compute[73520]:     </memballoon>
Aug 16 12:30:38 user nova-compute[73520]:   </devices>
Aug 16 12:30:38 user nova-compute[73520]: </domain>
Aug 16 12:30:38 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1383144430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1383144430',id=39,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-6nnhz2wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:30:15Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=52275f84-b38b-4351-befe-9052b1e02612,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:9f,bridge_name='br-int',has_traffic_filtering=True,id=614067cd-fd42-4bc4-8707-742fde3c1b05,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614067cd-fd') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG os_vif [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:9f,bridge_name='br-int',has_traffic_filtering=True,id=614067cd-fd42-4bc4-8707-742fde3c1b05,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614067cd-fd') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap614067cd-fd, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap614067cd-fd, col_values=(('external_ids', {'iface-id': '614067cd-fd42-4bc4-8707-742fde3c1b05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:5b:9f', 'vm-uuid': '52275f84-b38b-4351-befe-9052b1e02612'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:38 user nova-compute[73520]: INFO os_vif [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:5b:9f,bridge_name='br-int',has_traffic_filtering=True,id=614067cd-fd42-4bc4-8707-742fde3c1b05,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614067cd-fd')
Aug 16 12:30:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:30:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No VIF found with MAC fa:16:3e:34:5b:9f, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:30:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:39 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:30:39 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:30:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:30:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-d1c7c5f1-d14b-41f1-83db-b8dae78a7a43 req-a068a7d1-6303-4584-971c-c5dc1b09ed47 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d1c7c5f1-d14b-41f1-83db-b8dae78a7a43 req-a068a7d1-6303-4584-971c-c5dc1b09ed47 service nova] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d1c7c5f1-d14b-41f1-83db-b8dae78a7a43 req-a068a7d1-6303-4584-971c-c5dc1b09ed47 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d1c7c5f1-d14b-41f1-83db-b8dae78a7a43 req-a068a7d1-6303-4584-971c-c5dc1b09ed47 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-d1c7c5f1-d14b-41f1-83db-b8dae78a7a43 req-a068a7d1-6303-4584-971c-c5dc1b09ed47 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] No waiting events found dispatching network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:40 user nova-compute[73520]: WARNING nova.compute.manager [req-d1c7c5f1-d14b-41f1-83db-b8dae78a7a43 req-a068a7d1-6303-4584-971c-c5dc1b09ed47 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received unexpected event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 for instance with vm_state building and task_state spawning.
Aug 16 12:30:41 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:30:41 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189041.9676805, 52275f84-b38b-4351-befe-9052b1e02612 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:30:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] VM Resumed (Lifecycle Event)
Aug 16 12:30:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:30:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:30:41 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Instance spawned successfully.
Aug 16 12:30:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:30:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:30:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:42 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:30:42 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189041.9688447, 52275f84-b38b-4351-befe-9052b1e02612 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:30:42 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] VM Started (Lifecycle Event)
Aug 16 12:30:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:30:42 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:30:42 user nova-compute[73520]: INFO nova.compute.manager [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 16 12:30:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-b79e5fc7-9154-408a-8bc5-c337e2ff7686 req-8e434896-8bc8-4377-a3dd-1c2c187d834a service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b79e5fc7-9154-408a-8bc5-c337e2ff7686 req-8e434896-8bc8-4377-a3dd-1c2c187d834a service nova] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b79e5fc7-9154-408a-8bc5-c337e2ff7686 req-8e434896-8bc8-4377-a3dd-1c2c187d834a service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b79e5fc7-9154-408a-8bc5-c337e2ff7686 req-8e434896-8bc8-4377-a3dd-1c2c187d834a service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-b79e5fc7-9154-408a-8bc5-c337e2ff7686 req-8e434896-8bc8-4377-a3dd-1c2c187d834a service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] No waiting events found dispatching network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:42 user nova-compute[73520]: WARNING nova.compute.manager [req-b79e5fc7-9154-408a-8bc5-c337e2ff7686 req-8e434896-8bc8-4377-a3dd-1c2c187d834a service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received unexpected event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 for instance with vm_state building and task_state spawning.
Aug 16 12:30:42 user nova-compute[73520]: INFO nova.compute.manager [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Took 28.37 seconds to build instance.
Aug 16 12:30:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-64e77420-aa93-46c6-958e-4265a222ae9b tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "52275f84-b38b-4351-befe-9052b1e02612" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.591s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:30:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:30:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:43 user nova-compute[73520]: DEBUG nova.compute.manager [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:30:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:43 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:30:43 user nova-compute[73520]: INFO nova.compute.claims [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Claim successful on node user
Aug 16 12:30:43 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:30:43 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189028.9349425, 61633714-d25e-4cde-b757-b3c3f6fd8d71 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:30:43 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] VM Stopped (Lifecycle Event)
Aug 16 12:30:43 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:30:43 user nova-compute[73520]: DEBUG nova.compute.manager [None req-0ac4786f-0cce-4350-84d2-76ae949d72a5 None None] [instance: 61633714-d25e-4cde-b757-b3c3f6fd8d71] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:30:43 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:30:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:43 user nova-compute[73520]: DEBUG nova.compute.manager [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG nova.network.neutron [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:30:44 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:30:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:30:44 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Creating image(s)
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "/opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "/opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG nova.policy [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d1fb48f56ed426b8cc984a7973ab208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1870ba83d8124a6c9624afde2cdd3752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk 1073741824" returned: 0 in 0.050s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Cannot resize image /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG nova.objects.instance [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lazy-loading 'migration_context' on Instance uuid 1a8276cb-495e-4e55-aa8b-02b18118b51e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Ensure instance console log exists: /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG nova.network.neutron [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Successfully created port: 70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG nova.network.neutron [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Successfully updated port: 70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "refresh_cache-1a8276cb-495e-4e55-aa8b-02b18118b51e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquired lock "refresh_cache-1a8276cb-495e-4e55-aa8b-02b18118b51e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:30:45 user nova-compute[73520]: DEBUG nova.network.neutron [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-34dd0952-4a00-4ac4-8f28-16635f0e6d58 req-a29b6d79-5f3a-44fd-878d-4a9cbb3b5c62 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Received event network-changed-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-34dd0952-4a00-4ac4-8f28-16635f0e6d58 req-a29b6d79-5f3a-44fd-878d-4a9cbb3b5c62 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Refreshing instance network info cache due to event network-changed-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-34dd0952-4a00-4ac4-8f28-16635f0e6d58 req-a29b6d79-5f3a-44fd-878d-4a9cbb3b5c62 service nova] Acquiring lock "refresh_cache-1a8276cb-495e-4e55-aa8b-02b18118b51e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Updating instance_info_cache with network_info: [{"id": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "address": "fa:16:3e:32:b9:30", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70bf9e8e-1f", "ovs_interfaceid": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Releasing lock "refresh_cache-1a8276cb-495e-4e55-aa8b-02b18118b51e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.compute.manager [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Instance network_info: |[{"id": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "address": "fa:16:3e:32:b9:30", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70bf9e8e-1f", "ovs_interfaceid": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-34dd0952-4a00-4ac4-8f28-16635f0e6d58 req-a29b6d79-5f3a-44fd-878d-4a9cbb3b5c62 service nova] Acquired lock "refresh_cache-1a8276cb-495e-4e55-aa8b-02b18118b51e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.network.neutron [req-34dd0952-4a00-4ac4-8f28-16635f0e6d58 req-a29b6d79-5f3a-44fd-878d-4a9cbb3b5c62 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Refreshing network info cache for port 70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Start _get_guest_xml network_info=[{"id": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "address": "fa:16:3e:32:b9:30", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70bf9e8e-1f", "ovs_interfaceid": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:46 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:30:46 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1289886783',display_name='tempest-VolumesSnapshotTestJSON-instance-1289886783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1289886783',id=40,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0QJvFv496IJWriUK3tBwQA23SPAB0VMCBSOCTujg+ASpQZpM58FbSp0KgFBStqK5CnwGLC/H0CCF6UWHqPIw46x2ApgJgP8Z7VFsLP1lFyUr1K99CtfMun9xAal4OQXg==',key_name='tempest-keypair-432646912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1870ba83d8124a6c9624afde2cdd3752',ramdisk_id='',reservation_id='r-sy6v1i6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1304228647',owner_user_name='tempest-VolumesSnapshotTestJSON-1304228647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d1fb48f56ed426b8cc984a7973ab208',uuid=1a8276cb-495e-4e55-aa8b-02b18118b51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "address": "fa:16:3e:32:b9:30", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70bf9e8e-1f", "ovs_interfaceid": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Converting VIF {"id": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "address": "fa:16:3e:32:b9:30", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70bf9e8e-1f", "ovs_interfaceid": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:b9:30,bridge_name='br-int',has_traffic_filtering=True,id=70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70bf9e8e-1f') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.objects.instance [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a8276cb-495e-4e55-aa8b-02b18118b51e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:30:46 user nova-compute[73520]:   <uuid>1a8276cb-495e-4e55-aa8b-02b18118b51e</uuid>
Aug 16 12:30:46 user nova-compute[73520]:   <name>instance-00000028</name>
Aug 16 12:30:46 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:30:46 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:30:46 user nova-compute[73520]:   <metadata>
Aug 16 12:30:46 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:30:46 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:30:46 user nova-compute[73520]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1289886783</nova:name>
Aug 16 12:30:46 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:30:46</nova:creationTime>
Aug 16 12:30:46 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:30:46 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:30:46 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:30:46 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:30:46 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:30:46 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:30:46 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:30:46 user nova-compute[73520]:       <nova:owner>
Aug 16 12:30:46 user nova-compute[73520]:         <nova:user uuid="5d1fb48f56ed426b8cc984a7973ab208">tempest-VolumesSnapshotTestJSON-1304228647-project-member</nova:user>
Aug 16 12:30:46 user nova-compute[73520]:         <nova:project uuid="1870ba83d8124a6c9624afde2cdd3752">tempest-VolumesSnapshotTestJSON-1304228647</nova:project>
Aug 16 12:30:46 user nova-compute[73520]:       </nova:owner>
Aug 16 12:30:46 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:30:46 user nova-compute[73520]:       <nova:ports>
Aug 16 12:30:46 user nova-compute[73520]:         <nova:port uuid="70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad">
Aug 16 12:30:46 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 12:30:46 user nova-compute[73520]:         </nova:port>
Aug 16 12:30:46 user nova-compute[73520]:       </nova:ports>
Aug 16 12:30:46 user nova-compute[73520]:     </nova:instance>
Aug 16 12:30:46 user nova-compute[73520]:   </metadata>
Aug 16 12:30:46 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:30:46 user nova-compute[73520]:     <system>
Aug 16 12:30:46 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:30:46 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:30:46 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:30:46 user nova-compute[73520]:       <entry name="serial">1a8276cb-495e-4e55-aa8b-02b18118b51e</entry>
Aug 16 12:30:46 user nova-compute[73520]:       <entry name="uuid">1a8276cb-495e-4e55-aa8b-02b18118b51e</entry>
Aug 16 12:30:46 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:30:46 user nova-compute[73520]:     </system>
Aug 16 12:30:46 user nova-compute[73520]:   </sysinfo>
Aug 16 12:30:46 user nova-compute[73520]:   <os>
Aug 16 12:30:46 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:30:46 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:30:46 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:30:46 user nova-compute[73520]:   </os>
Aug 16 12:30:46 user nova-compute[73520]:   <features>
Aug 16 12:30:46 user nova-compute[73520]:     <acpi/>
Aug 16 12:30:46 user nova-compute[73520]:     <apic/>
Aug 16 12:30:46 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:30:46 user nova-compute[73520]:   </features>
Aug 16 12:30:46 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:30:46 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:30:46 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:30:46 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:30:46 user nova-compute[73520]:   </clock>
Aug 16 12:30:46 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:30:46 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:30:46 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:30:46 user nova-compute[73520]:   </cpu>
Aug 16 12:30:46 user nova-compute[73520]:   <devices>
Aug 16 12:30:46 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:30:46 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:30:46 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk"/>
Aug 16 12:30:46 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:30:46 user nova-compute[73520]:     </disk>
Aug 16 12:30:46 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:30:46 user nova-compute[73520]:       <mac address="fa:16:3e:32:b9:30"/>
Aug 16 12:30:46 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:30:46 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:30:46 user nova-compute[73520]:       <target dev="tap70bf9e8e-1f"/>
Aug 16 12:30:46 user nova-compute[73520]:     </interface>
Aug 16 12:30:46 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:30:46 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/console.log" append="off"/>
Aug 16 12:30:46 user nova-compute[73520]:     </serial>
Aug 16 12:30:46 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:30:46 user nova-compute[73520]:     <video>
Aug 16 12:30:46 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:30:46 user nova-compute[73520]:     </video>
Aug 16 12:30:46 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:30:46 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:30:46 user nova-compute[73520]:     </rng>
Aug 16 12:30:46 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:30:46 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:30:46 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:30:46 user nova-compute[73520]:     </memballoon>
Aug 16 12:30:46 user nova-compute[73520]:   </devices>
Aug 16 12:30:46 user nova-compute[73520]: </domain>
Aug 16 12:30:46 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1289886783',display_name='tempest-VolumesSnapshotTestJSON-instance-1289886783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1289886783',id=40,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0QJvFv496IJWriUK3tBwQA23SPAB0VMCBSOCTujg+ASpQZpM58FbSp0KgFBStqK5CnwGLC/H0CCF6UWHqPIw46x2ApgJgP8Z7VFsLP1lFyUr1K99CtfMun9xAal4OQXg==',key_name='tempest-keypair-432646912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1870ba83d8124a6c9624afde2cdd3752',ramdisk_id='',reservation_id='r-sy6v1i6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1304228647',owner_user_name='tempest-VolumesSnapshotTestJSON-1304228647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d1fb48f56ed426b8cc984a7973ab208',uuid=1a8276cb-495e-4e55-aa8b-02b18118b51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "address": "fa:16:3e:32:b9:30", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70bf9e8e-1f", "ovs_interfaceid": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Converting VIF {"id": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "address": "fa:16:3e:32:b9:30", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70bf9e8e-1f", "ovs_interfaceid": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:b9:30,bridge_name='br-int',has_traffic_filtering=True,id=70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70bf9e8e-1f') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG os_vif [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:b9:30,bridge_name='br-int',has_traffic_filtering=True,id=70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70bf9e8e-1f') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70bf9e8e-1f, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70bf9e8e-1f, col_values=(('external_ids', {'iface-id': '70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:b9:30', 'vm-uuid': '1a8276cb-495e-4e55-aa8b-02b18118b51e'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:46 user nova-compute[73520]: INFO os_vif [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:b9:30,bridge_name='br-int',has_traffic_filtering=True,id=70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70bf9e8e-1f')
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] No VIF found with MAC fa:16:3e:32:b9:30, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.network.neutron [req-34dd0952-4a00-4ac4-8f28-16635f0e6d58 req-a29b6d79-5f3a-44fd-878d-4a9cbb3b5c62 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Updated VIF entry in instance network info cache for port 70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG nova.network.neutron [req-34dd0952-4a00-4ac4-8f28-16635f0e6d58 req-a29b6d79-5f3a-44fd-878d-4a9cbb3b5c62 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Updating instance_info_cache with network_info: [{"id": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "address": "fa:16:3e:32:b9:30", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70bf9e8e-1f", "ovs_interfaceid": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-34dd0952-4a00-4ac4-8f28-16635f0e6d58 req-a29b6d79-5f3a-44fd-878d-4a9cbb3b5c62 service nova] Releasing lock "refresh_cache-1a8276cb-495e-4e55-aa8b-02b18118b51e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-9c175484-4d43-4d0e-a322-fe252f121ecf req-79555967-d2d0-45d5-8665-961dfaa6bc2d service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Received event network-vif-plugged-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9c175484-4d43-4d0e-a322-fe252f121ecf req-79555967-d2d0-45d5-8665-961dfaa6bc2d service nova] Acquiring lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9c175484-4d43-4d0e-a322-fe252f121ecf req-79555967-d2d0-45d5-8665-961dfaa6bc2d service nova] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9c175484-4d43-4d0e-a322-fe252f121ecf req-79555967-d2d0-45d5-8665-961dfaa6bc2d service nova] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-9c175484-4d43-4d0e-a322-fe252f121ecf req-79555967-d2d0-45d5-8665-961dfaa6bc2d service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] No waiting events found dispatching network-vif-plugged-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:48 user nova-compute[73520]: WARNING nova.compute.manager [req-9c175484-4d43-4d0e-a322-fe252f121ecf req-79555967-d2d0-45d5-8665-961dfaa6bc2d service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Received unexpected event network-vif-plugged-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad for instance with vm_state building and task_state spawning.
Aug 16 12:30:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189050.345277, 1a8276cb-495e-4e55-aa8b-02b18118b51e => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:30:50 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] VM Resumed (Lifecycle Event)
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-e2b8ba43-b121-45e3-b09e-b7721b74bc46 req-0a0f02d2-e297-48f0-9872-07bfa3f522c6 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Received event network-vif-plugged-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e2b8ba43-b121-45e3-b09e-b7721b74bc46 req-0a0f02d2-e297-48f0-9872-07bfa3f522c6 service nova] Acquiring lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e2b8ba43-b121-45e3-b09e-b7721b74bc46 req-0a0f02d2-e297-48f0-9872-07bfa3f522c6 service nova] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e2b8ba43-b121-45e3-b09e-b7721b74bc46 req-0a0f02d2-e297-48f0-9872-07bfa3f522c6 service nova] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-e2b8ba43-b121-45e3-b09e-b7721b74bc46 req-0a0f02d2-e297-48f0-9872-07bfa3f522c6 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] No waiting events found dispatching network-vif-plugged-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:50 user nova-compute[73520]: WARNING nova.compute.manager [req-e2b8ba43-b121-45e3-b09e-b7721b74bc46 req-0a0f02d2-e297-48f0-9872-07bfa3f522c6 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Received unexpected event network-vif-plugged-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad for instance with vm_state building and task_state spawning.
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:30:50 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:30:50 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7392MB free_disk=25.154552459716797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:50 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Instance spawned successfully.
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:30:50 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189050.3461707, 1a8276cb-495e-4e55-aa8b-02b18118b51e => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:30:50 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] VM Started (Lifecycle Event)
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:30:50 user nova-compute[73520]: INFO nova.compute.manager [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Applying migration context for instance 27659935-6eb3-4cea-9648-f5820cddda98 as it has an incoming, in-progress migration 2a6a042f-bef8-4b14-a008-d9d583fef295. Migration status is finished {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 12:30:50 user nova-compute[73520]: INFO nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating resource usage from migration 2a6a042f-bef8-4b14-a008-d9d583fef295
Aug 16 12:30:50 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d712e605-8ee2-4bd5-adce-61d0f284c835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Migration 2a6a042f-bef8-4b14-a008-d9d583fef295 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 27659935-6eb3-4cea-9648-f5820cddda98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 25b02048-2937-440a-9809-eceeb3558856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 52275f84-b38b-4351-befe-9052b1e02612 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1a8276cb-495e-4e55-aa8b-02b18118b51e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:30:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:30:50 user nova-compute[73520]: INFO nova.compute.manager [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Took 7.40 seconds to build instance.
Aug 16 12:30:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-98f254ab-f94b-402d-a0f6-58ab937e02e9 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.536s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:51 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:30:51 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:30:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:30:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:53 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:30:53 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:30:53 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:30:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:30:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:30:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:30:53 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:30:53 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updating instance_info_cache with network_info: [{"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:30:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:30:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:30:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:57 user nova-compute[73520]: INFO nova.compute.manager [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Terminating instance
Aug 16 12:30:57 user nova-compute[73520]: DEBUG nova.compute.manager [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:30:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-32d9080c-09bc-49b1-9571-5be3f7c1f4fe req-4e6eaf4c-910e-4b9f-b49b-ae02df0f418c service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received event network-vif-unplugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32d9080c-09bc-49b1-9571-5be3f7c1f4fe req-4e6eaf4c-910e-4b9f-b49b-ae02df0f418c service nova] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32d9080c-09bc-49b1-9571-5be3f7c1f4fe req-4e6eaf4c-910e-4b9f-b49b-ae02df0f418c service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32d9080c-09bc-49b1-9571-5be3f7c1f4fe req-4e6eaf4c-910e-4b9f-b49b-ae02df0f418c service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-32d9080c-09bc-49b1-9571-5be3f7c1f4fe req-4e6eaf4c-910e-4b9f-b49b-ae02df0f418c service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] No waiting events found dispatching network-vif-unplugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-32d9080c-09bc-49b1-9571-5be3f7c1f4fe req-4e6eaf4c-910e-4b9f-b49b-ae02df0f418c service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received event network-vif-unplugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:58 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Instance destroyed successfully.
Aug 16 12:30:58 user nova-compute[73520]: DEBUG nova.objects.instance [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'resources' on Instance uuid 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-399250487',display_name='tempest-ServerActionsTestOtherA-server-399250487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-399250487',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl3ev6edzI1KLHo1Y5B96ptBm6NSqIbcBOFcMZceXonYnWR3AckvFat7GQrt1EQ+8fQAGMP/p7GDPbXyfJwBrIOn5y+eKTCEQMF2Y9CFOeelDTAPhe+VbqGs9Aw6sueMA==',key_name='tempest-keypair-2118649879',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:26:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-mvskp7wz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:28:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=8c32e02c-2cca-46b4-a8e1-0eb854c4cb39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "address": "fa:16:3e:20:ac:77", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a58f602-1d", "ovs_interfaceid": "9a58f602-1dd8-46b4-8cc6-f5ef41b44750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_vif [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a58f602-1d, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:58 user nova-compute[73520]: INFO os_vif [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ac:77,bridge_name='br-int',has_traffic_filtering=True,id=9a58f602-1dd8-46b4-8cc6-f5ef41b44750,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a58f602-1d')
Aug 16 12:30:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saNpvoES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:30:58 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e0e013-c31e-4009-8d4d-883c94438512]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcce5c1-435b-4542-958c-8e91e34dd9ce]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:30:58 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:30:58 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:30:58 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:30:58 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:30:58 user nova-compute[73520]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 (non-flash)
Aug 16 12:30:58 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:30:58 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:30:58 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c75b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b6cf97-0b8c-40f5-b475-2c06364d4840]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4972857e-ef9c-498d-98c0-43bb1ed8b4ed]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[936a65bc-d3f5-4806-9c31-096d68d9c220]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d3c006-7d57-4225-b86b-b35646a6fadf]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_876c3330', '/dev/disk/by-id/scsi-1SCST_BIO876c3330-0b7a1f391968720c', '/dev/disk/by-id/scsi-23062376131663339') {{(pid=84372) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd48869-dd70-4f50-bf63-90da1a244cc8]: (4, None) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc14fbbd-76c9-4532-ae8c-71727dc2a329]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[985ff89f-2db5-4b36-be44-09d2c24475a1]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260]
Aug 16 12:30:59 user nova-compute[73520]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20, portal: 172.16.0.220,3260] successful.
Aug 16 12:30:59 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e370c4ce-2c3d-495a-a7c3-f138777b2f20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e72812-bbee-4c80-8ac1-38195ebb8aea]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] <== disconnect_volume: return (373ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:30:59 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Deleting instance files /opt/stack/data/nova/instances/8c32e02c-2cca-46b4-a8e1-0eb854c4cb39_del
Aug 16 12:30:59 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Deletion of /opt/stack/data/nova/instances/8c32e02c-2cca-46b4-a8e1-0eb854c4cb39_del complete
Aug 16 12:30:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:30:59 user nova-compute[73520]: INFO nova.compute.manager [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Took 1.40 seconds to destroy the instance on the hypervisor.
Aug 16 12:30:59 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:30:59 user nova-compute[73520]: INFO nova.compute.claims [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Claim successful on node user
Aug 16 12:30:59 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:30:59 user nova-compute[73520]: DEBUG nova.network.neutron [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:30:59 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:30:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:31:00 user nova-compute[73520]: INFO nova.virt.block_device [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Booting with volume 302ee37b-8d89-4d04-b0df-72d5e8b6d86d at /dev/vda
Aug 16 12:31:00 user nova-compute[73520]: DEBUG nova.policy [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17ed1823b0de433ab523470e235fdd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a693cd27934644be8e64731417c66783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG os_brick.utils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bff6bca-e872-4511-89b1-067573d04a1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.039s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6066259d-3068-4b5b-beb5-c07ea7a01b48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e725cece-7ce3-4833-b804-ec57d074f8f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eb1b84-2364-4ef4-af4f-4d1cf029b07e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-33127e41-877f-4dad-9cb7-5fc720d2c6d7 req-49aa5e6f-a216-40d2-9ab8-f931f4dd6ce8 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received event network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-33127e41-877f-4dad-9cb7-5fc720d2c6d7 req-49aa5e6f-a216-40d2-9ab8-f931f4dd6ce8 service nova] Acquiring lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-33127e41-877f-4dad-9cb7-5fc720d2c6d7 req-49aa5e6f-a216-40d2-9ab8-f931f4dd6ce8 service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-33127e41-877f-4dad-9cb7-5fc720d2c6d7 req-49aa5e6f-a216-40d2-9ab8-f931f4dd6ce8 service nova] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-33127e41-877f-4dad-9cb7-5fc720d2c6d7 req-49aa5e6f-a216-40d2-9ab8-f931f4dd6ce8 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] No waiting events found dispatching network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:31:00 user nova-compute[73520]: WARNING nova.compute.manager [req-33127e41-877f-4dad-9cb7-5fc720d2c6d7 req-49aa5e6f-a216-40d2-9ab8-f931f4dd6ce8 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received unexpected event network-vif-plugged-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 for instance with vm_state active and task_state deleting.
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:31:00 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:31:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[500963e7-bf30-4c38-8bf4-577302d3c07f]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG os_brick.utils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Updating existing volume attachment record: 7aa81979-9208-4cd6-9ec9-5a090ed57a42 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:31:00 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Took 1.08 seconds to deallocate network for instance.
Aug 16 12:31:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-1a5c2cd4-8d80-4550-b79f-0d35374e5ffb req-8622c346-ad39-4085-be70-133f5f84d5f9 service nova] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Received event network-vif-deleted-9a58f602-1dd8-46b4-8cc6-f5ef41b44750 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:31:00 user nova-compute[73520]: DEBUG nova.network.neutron [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Successfully created port: dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:31:01 user nova-compute[73520]: INFO nova.compute.manager [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Took 0.88 seconds to detach 1 volumes for instance.
Aug 16 12:31:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Deleting volume: e370c4ce-2c3d-495a-a7c3-f138777b2f20 {{(pid=73520) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 12:31:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:01 user nova-compute[73520]: DEBUG nova.network.neutron [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Successfully updated port: dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:31:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "refresh_cache-ce0355be-8b0e-4c8c-b052-10ac730fa6cf" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:31:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquired lock "refresh_cache-ce0355be-8b0e-4c8c-b052-10ac730fa6cf" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:31:01 user nova-compute[73520]: DEBUG nova.network.neutron [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:31:01 user nova-compute[73520]: DEBUG nova.network.neutron [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:31:01 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:31:01 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:31:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:01 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Deleted allocations for instance 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39
Aug 16 12:31:02 user nova-compute[73520]: DEBUG nova.network.neutron [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Updating instance_info_cache with network_info: [{"id": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "address": "fa:16:3e:c1:d5:79", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc85c0d3-f2", "ovs_interfaceid": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:31:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-967d4af9-66a8-4f01-bd1c-c1827cf94edc tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "8c32e02c-2cca-46b4-a8e1-0eb854c4cb39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.196s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Releasing lock "refresh_cache-ce0355be-8b0e-4c8c-b052-10ac730fa6cf" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:31:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Instance network_info: |[{"id": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "address": "fa:16:3e:c1:d5:79", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc85c0d3-f2", "ovs_interfaceid": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:31:02 user nova-compute[73520]: DEBUG nova.compute.manager [req-b4ea5d2d-9d74-4dcd-81d4-1f35f6c48eca req-b8874ee0-9fe5-454b-a772-aca6815731ef service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Received event network-changed-dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:31:02 user nova-compute[73520]: DEBUG nova.compute.manager [req-b4ea5d2d-9d74-4dcd-81d4-1f35f6c48eca req-b8874ee0-9fe5-454b-a772-aca6815731ef service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Refreshing instance network info cache due to event network-changed-dc85c0d3-f29f-4255-84ed-38c36ebdb094. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:31:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b4ea5d2d-9d74-4dcd-81d4-1f35f6c48eca req-b8874ee0-9fe5-454b-a772-aca6815731ef service nova] Acquiring lock "refresh_cache-ce0355be-8b0e-4c8c-b052-10ac730fa6cf" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:31:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b4ea5d2d-9d74-4dcd-81d4-1f35f6c48eca req-b8874ee0-9fe5-454b-a772-aca6815731ef service nova] Acquired lock "refresh_cache-ce0355be-8b0e-4c8c-b052-10ac730fa6cf" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:31:02 user nova-compute[73520]: DEBUG nova.network.neutron [req-b4ea5d2d-9d74-4dcd-81d4-1f35f6c48eca req-b8874ee0-9fe5-454b-a772-aca6815731ef service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Refreshing network info cache for port dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:31:02 user nova-compute[73520]: DEBUG nova.network.neutron [req-b4ea5d2d-9d74-4dcd-81d4-1f35f6c48eca req-b8874ee0-9fe5-454b-a772-aca6815731ef service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Updated VIF entry in instance network info cache for port dc85c0d3-f29f-4255-84ed-38c36ebdb094. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:31:02 user nova-compute[73520]: DEBUG nova.network.neutron [req-b4ea5d2d-9d74-4dcd-81d4-1f35f6c48eca req-b8874ee0-9fe5-454b-a772-aca6815731ef service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Updating instance_info_cache with network_info: [{"id": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "address": "fa:16:3e:c1:d5:79", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc85c0d3-f2", "ovs_interfaceid": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:31:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b4ea5d2d-9d74-4dcd-81d4-1f35f6c48eca req-b8874ee0-9fe5-454b-a772-aca6815731ef service nova] Releasing lock "refresh_cache-ce0355be-8b0e-4c8c-b052-10ac730fa6cf" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:31:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:31:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Creating image(s)
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Ensure instance console log exists: /opt/stack/data/nova/instances/ce0355be-8b0e-4c8c-b052-10ac730fa6cf/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Start _get_guest_xml network_info=[{"id": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "address": "fa:16:3e:c1:d5:79", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc85c0d3-f2", "ovs_interfaceid": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqXJxpaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ce0355be-8b0e-4c8c-b052-10ac730fa6cf', 'attached_at': '', 'detached_at': '', 'volume_id': '302ee37b-8d89-4d04-b0df-72d5e8b6d86d', 'serial': '302ee37b-8d89-4d04-b0df-72d5e8b6d86d'}, 'attachment_id': '7aa81979-9208-4cd6-9ec9-5a090ed57a42', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:31:11 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:31:11 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqXJxpaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:31:11 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:31:11 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:31:11 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c80013-495e-48c7-b017-9c0b52d31faa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:31:11 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd05f2d-bf4b-4ba3-9b68-519caadc1644]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d] added
Aug 16 12:31:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81635a0-8e6f-4b0f-9e46-60481d2a11ef]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d956e9-d097-4711-923b-3da57b347bbd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WqXJxpaw {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WqXJxpaw" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[be86778e-3356-48d3-a9a6-bf372152f9e2]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WqXJxpaw'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d34653e-fc37-4b59-aa7f-73602e8b08e8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[304a4424-9eb2-4ef4-a927-92f2b1bea584]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:31:11 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:31:11 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:31:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:31:11 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:31:11 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:31:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9b8740-8bcc-4c51-b895-1c893eeaa9a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260]
Aug 16 12:31:11 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260] successful.
Aug 16 12:31:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb18937e-a1c1-4246-a05d-b07c2561772d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f13f3c-55a9-4333-adf2-1538888a61a5]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:31:11 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:31:11 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:31:11 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:31:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:31:11 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:31:11 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:31:11 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:31:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa87add-a863-4cf5-9b53-98bcf127ebbf]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:11 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqXJxpaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23765636232323237', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765636232323237', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1596451022',display_name='tempest-TestVolumeBootPattern-server-1596451022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1596451022',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJr/o6vrVZnxmYhfYixlxoifuhCtvsj5vKkg3ZAc0JSOeGoo3PmY57Yx5t3KGcWwXVP9aD5zqccktnbo7190qT8/kMlT5jQNhZVEjx4vkSe9H5//tD72sKPKPHQkEbRmQ==',key_name='tempest-TestVolumeBootPattern-586845281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-5fd3cnsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:31:00Z,user_data=None,user_id='17ed1823b0de433ab523470e235fdd72',uuid=ce0355be-8b0e-4c8c-b052-10ac730fa6cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "address": "fa:16:3e:c1:d5:79", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc85c0d3-f2", "ovs_interfaceid": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "address": "fa:16:3e:c1:d5:79", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc85c0d3-f2", "ovs_interfaceid": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d5:79,bridge_name='br-int',has_traffic_filtering=True,id=dc85c0d3-f29f-4255-84ed-38c36ebdb094,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc85c0d3-f2') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG nova.objects.instance [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lazy-loading 'pci_devices' on Instance uuid ce0355be-8b0e-4c8c-b052-10ac730fa6cf {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:31:12 user nova-compute[73520]:   <uuid>ce0355be-8b0e-4c8c-b052-10ac730fa6cf</uuid>
Aug 16 12:31:12 user nova-compute[73520]:   <name>instance-00000029</name>
Aug 16 12:31:12 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:31:12 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:31:12 user nova-compute[73520]:   <metadata>
Aug 16 12:31:12 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:31:12 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:31:12 user nova-compute[73520]:       <nova:name>tempest-TestVolumeBootPattern-server-1596451022</nova:name>
Aug 16 12:31:12 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:31:11</nova:creationTime>
Aug 16 12:31:12 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:31:12 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:31:12 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:31:12 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:31:12 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:31:12 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:31:12 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:31:12 user nova-compute[73520]:       <nova:owner>
Aug 16 12:31:12 user nova-compute[73520]:         <nova:user uuid="17ed1823b0de433ab523470e235fdd72">tempest-TestVolumeBootPattern-496055159-project-member</nova:user>
Aug 16 12:31:12 user nova-compute[73520]:         <nova:project uuid="a693cd27934644be8e64731417c66783">tempest-TestVolumeBootPattern-496055159</nova:project>
Aug 16 12:31:12 user nova-compute[73520]:       </nova:owner>
Aug 16 12:31:12 user nova-compute[73520]:       <nova:ports>
Aug 16 12:31:12 user nova-compute[73520]:         <nova:port uuid="dc85c0d3-f29f-4255-84ed-38c36ebdb094">
Aug 16 12:31:12 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 12:31:12 user nova-compute[73520]:         </nova:port>
Aug 16 12:31:12 user nova-compute[73520]:       </nova:ports>
Aug 16 12:31:12 user nova-compute[73520]:     </nova:instance>
Aug 16 12:31:12 user nova-compute[73520]:   </metadata>
Aug 16 12:31:12 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:31:12 user nova-compute[73520]:     <system>
Aug 16 12:31:12 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:31:12 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:31:12 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:31:12 user nova-compute[73520]:       <entry name="serial">ce0355be-8b0e-4c8c-b052-10ac730fa6cf</entry>
Aug 16 12:31:12 user nova-compute[73520]:       <entry name="uuid">ce0355be-8b0e-4c8c-b052-10ac730fa6cf</entry>
Aug 16 12:31:12 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:31:12 user nova-compute[73520]:     </system>
Aug 16 12:31:12 user nova-compute[73520]:   </sysinfo>
Aug 16 12:31:12 user nova-compute[73520]:   <os>
Aug 16 12:31:12 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:31:12 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:31:12 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:31:12 user nova-compute[73520]:   </os>
Aug 16 12:31:12 user nova-compute[73520]:   <features>
Aug 16 12:31:12 user nova-compute[73520]:     <acpi/>
Aug 16 12:31:12 user nova-compute[73520]:     <apic/>
Aug 16 12:31:12 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:31:12 user nova-compute[73520]:   </features>
Aug 16 12:31:12 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:31:12 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:31:12 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:31:12 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:31:12 user nova-compute[73520]:   </clock>
Aug 16 12:31:12 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:31:12 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:31:12 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:31:12 user nova-compute[73520]:   </cpu>
Aug 16 12:31:12 user nova-compute[73520]:   <devices>
Aug 16 12:31:12 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:31:12 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:31:12 user nova-compute[73520]:       <source dev="/dev/sdb"/>
Aug 16 12:31:12 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:31:12 user nova-compute[73520]:       <serial>302ee37b-8d89-4d04-b0df-72d5e8b6d86d</serial>
Aug 16 12:31:12 user nova-compute[73520]:     </disk>
Aug 16 12:31:12 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:31:12 user nova-compute[73520]:       <mac address="fa:16:3e:c1:d5:79"/>
Aug 16 12:31:12 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:31:12 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:31:12 user nova-compute[73520]:       <target dev="tapdc85c0d3-f2"/>
Aug 16 12:31:12 user nova-compute[73520]:     </interface>
Aug 16 12:31:12 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:31:12 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/ce0355be-8b0e-4c8c-b052-10ac730fa6cf/console.log" append="off"/>
Aug 16 12:31:12 user nova-compute[73520]:     </serial>
Aug 16 12:31:12 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:31:12 user nova-compute[73520]:     <video>
Aug 16 12:31:12 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:31:12 user nova-compute[73520]:     </video>
Aug 16 12:31:12 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:31:12 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:31:12 user nova-compute[73520]:     </rng>
Aug 16 12:31:12 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:31:12 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:31:12 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:31:12 user nova-compute[73520]:     </memballoon>
Aug 16 12:31:12 user nova-compute[73520]:   </devices>
Aug 16 12:31:12 user nova-compute[73520]: </domain>
Aug 16 12:31:12 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1596451022',display_name='tempest-TestVolumeBootPattern-server-1596451022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1596451022',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJr/o6vrVZnxmYhfYixlxoifuhCtvsj5vKkg3ZAc0JSOeGoo3PmY57Yx5t3KGcWwXVP9aD5zqccktnbo7190qT8/kMlT5jQNhZVEjx4vkSe9H5//tD72sKPKPHQkEbRmQ==',key_name='tempest-TestVolumeBootPattern-586845281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-5fd3cnsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:31:00Z,user_data=None,user_id='17ed1823b0de433ab523470e235fdd72',uuid=ce0355be-8b0e-4c8c-b052-10ac730fa6cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "address": "fa:16:3e:c1:d5:79", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc85c0d3-f2", "ovs_interfaceid": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "address": "fa:16:3e:c1:d5:79", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc85c0d3-f2", "ovs_interfaceid": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d5:79,bridge_name='br-int',has_traffic_filtering=True,id=dc85c0d3-f29f-4255-84ed-38c36ebdb094,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc85c0d3-f2') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG os_vif [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d5:79,bridge_name='br-int',has_traffic_filtering=True,id=dc85c0d3-f29f-4255-84ed-38c36ebdb094,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc85c0d3-f2') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc85c0d3-f2, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc85c0d3-f2, col_values=(('external_ids', {'iface-id': 'dc85c0d3-f29f-4255-84ed-38c36ebdb094', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:d5:79', 'vm-uuid': 'ce0355be-8b0e-4c8c-b052-10ac730fa6cf'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:12 user nova-compute[73520]: INFO os_vif [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:d5:79,bridge_name='br-int',has_traffic_filtering=True,id=dc85c0d3-f29f-4255-84ed-38c36ebdb094,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc85c0d3-f2')
Aug 16 12:31:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:31:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] No VIF found with MAC fa:16:3e:c1:d5:79, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:31:13 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189058.651996, 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:31:13 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] VM Stopped (Lifecycle Event)
Aug 16 12:31:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-51a9ed51-c533-4be2-95e3-a984312d673e None None] [instance: 8c32e02c-2cca-46b4-a8e1-0eb854c4cb39] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:31:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-f8dbbf9c-5103-405c-94b8-b944e48a577c req-b23ae99a-899c-4ce0-8baa-150108df695c service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Received event network-vif-plugged-dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:31:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f8dbbf9c-5103-405c-94b8-b944e48a577c req-b23ae99a-899c-4ce0-8baa-150108df695c service nova] Acquiring lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f8dbbf9c-5103-405c-94b8-b944e48a577c req-b23ae99a-899c-4ce0-8baa-150108df695c service nova] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f8dbbf9c-5103-405c-94b8-b944e48a577c req-b23ae99a-899c-4ce0-8baa-150108df695c service nova] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-f8dbbf9c-5103-405c-94b8-b944e48a577c req-b23ae99a-899c-4ce0-8baa-150108df695c service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] No waiting events found dispatching network-vif-plugged-dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:31:14 user nova-compute[73520]: WARNING nova.compute.manager [req-f8dbbf9c-5103-405c-94b8-b944e48a577c req-b23ae99a-899c-4ce0-8baa-150108df695c service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Received unexpected event network-vif-plugged-dc85c0d3-f29f-4255-84ed-38c36ebdb094 for instance with vm_state building and task_state spawning.
Aug 16 12:31:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189076.2218833, ce0355be-8b0e-4c8c-b052-10ac730fa6cf => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:31:16 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] VM Resumed (Lifecycle Event)
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:31:16 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Instance spawned successfully.
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:31:16 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189076.2245169, ce0355be-8b0e-4c8c-b052-10ac730fa6cf => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:31:16 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] VM Started (Lifecycle Event)
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:31:16 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:31:16 user nova-compute[73520]: INFO nova.compute.manager [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Took 5.19 seconds to spawn the instance on the hypervisor.
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:31:16 user nova-compute[73520]: INFO nova.compute.manager [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Took 17.13 seconds to build instance.
Aug 16 12:31:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1cac5557-9262-44cc-b503-0f1586aad5db tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.367s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-ba37b896-c1fa-47ea-bc93-701864aa2cfe req-d5d42f78-24ee-40cb-bf2a-9fe0624e0fd9 service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Received event network-vif-plugged-dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ba37b896-c1fa-47ea-bc93-701864aa2cfe req-d5d42f78-24ee-40cb-bf2a-9fe0624e0fd9 service nova] Acquiring lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ba37b896-c1fa-47ea-bc93-701864aa2cfe req-d5d42f78-24ee-40cb-bf2a-9fe0624e0fd9 service nova] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ba37b896-c1fa-47ea-bc93-701864aa2cfe req-d5d42f78-24ee-40cb-bf2a-9fe0624e0fd9 service nova] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-ba37b896-c1fa-47ea-bc93-701864aa2cfe req-d5d42f78-24ee-40cb-bf2a-9fe0624e0fd9 service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] No waiting events found dispatching network-vif-plugged-dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:31:16 user nova-compute[73520]: WARNING nova.compute.manager [req-ba37b896-c1fa-47ea-bc93-701864aa2cfe req-d5d42f78-24ee-40cb-bf2a-9fe0624e0fd9 service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Received unexpected event network-vif-plugged-dc85c0d3-f29f-4255-84ed-38c36ebdb094 for instance with vm_state active and task_state None.
Aug 16 12:31:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:21 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Port 8018c557-722c-41a7-91e0-f63bc6568bac binding to destination host user is already ACTIVE {{(pid=73520) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 12:31:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:31:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquired lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:31:21 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:31:21 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating instance_info_cache with network_info: [{"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:31:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Releasing lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:31:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Creating tmpfile /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/tmpj_6rpc82 to verify with other compute node that the instance is on the same shared storage. {{(pid=73520) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-e67cb74f-85fc-40e9-989e-c01369adc6ed req-4965123a-5339-4810-8221-5adab8edaaae service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-unplugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e67cb74f-85fc-40e9-989e-c01369adc6ed req-4965123a-5339-4810-8221-5adab8edaaae service nova] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e67cb74f-85fc-40e9-989e-c01369adc6ed req-4965123a-5339-4810-8221-5adab8edaaae service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e67cb74f-85fc-40e9-989e-c01369adc6ed req-4965123a-5339-4810-8221-5adab8edaaae service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-e67cb74f-85fc-40e9-989e-c01369adc6ed req-4965123a-5339-4810-8221-5adab8edaaae service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] No waiting events found dispatching network-vif-unplugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:31:22 user nova-compute[73520]: WARNING nova.compute.manager [req-e67cb74f-85fc-40e9-989e-c01369adc6ed req-4965123a-5339-4810-8221-5adab8edaaae service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received unexpected event network-vif-unplugged-8018c557-722c-41a7-91e0-f63bc6568bac for instance with vm_state resized and task_state resize_reverting.
Aug 16 12:31:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:22 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Instance destroyed successfully.
Aug 16 12:31:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lazy-loading 'resources' on Instance uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:25:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-576632488',display_name='tempest-ServerActionsTestOtherB-server-576632488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-576632488',id=34,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa+wt9FJevF0VcG5IW9UPpcwllZecsxipO+cOwPONy0JXrxwIIn5VueYzwt5Y4Fz26HPB5B2yhLRiuQ1H/JJF0RqBlDYiGwQFxVVbFuKbbBpDS5B0RYzbNj/n52YCPO2A==',key_name='tempest-keypair-872928149',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65805b8eab71460caf571e52648c40d4',ramdisk_id='',reservation_id='r-54clw1uk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1849139886',owner_user_name='tempest-ServerActionsTestOtherB-1849139886-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:29:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='354985a41cf846dab967f7d238e19319',uuid=27659935-6eb3-4cea-9648-f5820cddda98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converting VIF {"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG os_vif [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8018c557-72, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:31:22 user nova-compute[73520]: INFO os_vif [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72')
Aug 16 12:31:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSLAzyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:31:22 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:31:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be195ad-cced-4fed-9048-3df681339c49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d38f67-bb51-4c6c-9372-1c644d4ad134]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:31:22 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:31:22 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:31:22 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:31:22 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:31:22 user nova-compute[73520]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:31:22 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:31:22 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:31:22 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa77693f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7'): ({'sde'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Removing single pathed devices sde {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96c330d-7696-455d-ae79-f43f4d8221ec]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff51de28-065b-4ae6-874e-149a82a10873]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Flushing IO for device /dev/sde {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9acc65b-903b-4262-bed7-9381a5f7b8cd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[21098046-57cc-49ab-8f77-99c98091ae3c]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[976f4e4b-16a7-48ce-afd3-f534c04ae887]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5db47b-4b66-450b-8596-6ab238eea9b0]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260]
Aug 16 12:31:23 user nova-compute[73520]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260] successful.
Aug 16 12:31:23 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[be608774-b2f8-4ddb-952c-4158b23dd74f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] <== disconnect_volume: return (291ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:31:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:31:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:24 user nova-compute[73520]: DEBUG nova.objects.instance [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lazy-loading 'migration_context' on Instance uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:31:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-81061efc-6695-4f75-8079-a2bf0e709cab req-4f4547e6-bc17-481b-a666-905e64cfce74 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:31:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-81061efc-6695-4f75-8079-a2bf0e709cab req-4f4547e6-bc17-481b-a666-905e64cfce74 service nova] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-81061efc-6695-4f75-8079-a2bf0e709cab req-4f4547e6-bc17-481b-a666-905e64cfce74 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-81061efc-6695-4f75-8079-a2bf0e709cab req-4f4547e6-bc17-481b-a666-905e64cfce74 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-81061efc-6695-4f75-8079-a2bf0e709cab req-4f4547e6-bc17-481b-a666-905e64cfce74 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] No waiting events found dispatching network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:31:24 user nova-compute[73520]: WARNING nova.compute.manager [req-81061efc-6695-4f75-8079-a2bf0e709cab req-4f4547e6-bc17-481b-a666-905e64cfce74 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received unexpected event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac for instance with vm_state resized and task_state resize_reverting.
Aug 16 12:31:24 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:31:24 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:31:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.474s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:24 user nova-compute[73520]: INFO nova.compute.manager [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Swapping old allocation on dict_keys(['70dde5f5-9594-47c3-954e-598dd3089747']) held by migration 2a6a042f-bef8-4b14-a008-d9d583fef295 for instance
Aug 16 12:31:24 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Overwriting current allocation {'allocations': {'70dde5f5-9594-47c3-954e-598dd3089747': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 50}}, 'project_id': '65805b8eab71460caf571e52648c40d4', 'user_id': '354985a41cf846dab967f7d238e19319', 'consumer_generation': 1} on consumer 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquired lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating instance_info_cache with network_info: [{"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Releasing lock "refresh_cache-27659935-6eb3-4cea-9648-f5820cddda98" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG os_brick.utils [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d05dc82-2bb5-4b28-b652-a16839d050fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[accd2dbe-4eec-4c5f-96ef-124d67954686]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b02407c-ebd2-4c83-8363-b1a1f269c3ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e8f87e-d31b-436e-bc60-07c112ccf441]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:31:25 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:31:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebcc3d5-22b1-4e02-aace-951b8abd3439]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:31:25 user nova-compute[73520]: DEBUG os_brick.utils [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:31:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:31:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:31:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:31:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:31:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Starting finish_revert_migration {{(pid=73520) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Start _get_guest_xml network_info=[{"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSLAzyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '27659935-6eb3-4cea-9648-f5820cddda98', 'attached_at': '2023-08-16T12:31:36.000000', 'detached_at': '', 'volume_id': 'ccfc736d-08db-4664-b12e-9955e4fc00f7', 'serial': 'ccfc736d-08db-4664-b12e-9955e4fc00f7'}, 'attachment_id': '4dbe8664-e4cf-457e-a8ef-13b6534b4486', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:31:36 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:31:36 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.objects.instance [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lazy-loading 'vcpu_model' on Instance uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSLAzyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:31:36 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:31:36 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:31:36 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5831fc94-402d-4931-94c6-e658adae8dad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:31:36 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdecd319-9d30-4a15-9da0-46bdaff05477]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7] added
Aug 16 12:31:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f3e20b-5603-46f2-851a-e3373f5b3bb2]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d289a6c-4bca-4c8f-9451-0bd42f769d2d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSLAzyXG {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSLAzyXG" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1ada90-0367-44d5-bd77-fda89a0bfef9]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WSLAzyXG'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ee3a42-e464-418e-bbb8-b4a1dd02c849]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[90521de8-4468-43b3-9ac7-758c65abfddd]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:31:36 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:31:36 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:31:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:31:36 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:31:36 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:31:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8693cd-2f1a-449f-8059-8a802702a0da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260]
Aug 16 12:31:36 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260] successful.
Aug 16 12:31:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9067ea3-34b4-4111-9d30-0800a58d3ddc]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5815d03e-4366-42d8-b8e6-c3e1d31f7685]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:31:36 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:31:36 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:31:36 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:31:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:31:36 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:31:36 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:31:36 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:31:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2da021e-cefc-43dc-8f40-b167bea41a75]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:31:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSLAzyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:31:37 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189082.7735627, 27659935-6eb3-4cea-9648-f5820cddda98 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:31:37 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] VM Stopped (Lifecycle Event)
Aug 16 12:31:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6e6e1f52-1e08-4042-93ed-161b3e340bd9 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:31:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:31:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23134663837613561', 'path': '/dev/sde'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:31:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134663837613561', 'path': '/dev/sde'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:25:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-576632488',display_name='tempest-ServerActionsTestOtherB-server-576632488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-576632488',id=34,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa+wt9FJevF0VcG5IW9UPpcwllZecsxipO+cOwPONy0JXrxwIIn5VueYzwt5Y4Fz26HPB5B2yhLRiuQ1H/JJF0RqBlDYiGwQFxVVbFuKbbBpDS5B0RYzbNj/n52YCPO2A==',key_name='tempest-keypair-872928149',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='65805b8eab71460caf571e52648c40d4',ramdisk_id='',reservation_id='r-54clw1uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1849139886',owner_user_name='tempest-ServerActionsTestOtherB-1849139886-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:31:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='354985a41cf846dab967f7d238e19319',uuid=27659935-6eb3-4cea-9648-f5820cddda98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converting VIF {"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:31:38 user nova-compute[73520]:   <uuid>27659935-6eb3-4cea-9648-f5820cddda98</uuid>
Aug 16 12:31:38 user nova-compute[73520]:   <name>instance-00000022</name>
Aug 16 12:31:38 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:31:38 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:31:38 user nova-compute[73520]:   <metadata>
Aug 16 12:31:38 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:31:38 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:31:38 user nova-compute[73520]:       <nova:name>tempest-ServerActionsTestOtherB-server-576632488</nova:name>
Aug 16 12:31:38 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:31:36</nova:creationTime>
Aug 16 12:31:38 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:31:38 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:31:38 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:31:38 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:31:38 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:31:38 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:31:38 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:31:38 user nova-compute[73520]:       <nova:owner>
Aug 16 12:31:38 user nova-compute[73520]:         <nova:user uuid="354985a41cf846dab967f7d238e19319">tempest-ServerActionsTestOtherB-1849139886-project-member</nova:user>
Aug 16 12:31:38 user nova-compute[73520]:         <nova:project uuid="65805b8eab71460caf571e52648c40d4">tempest-ServerActionsTestOtherB-1849139886</nova:project>
Aug 16 12:31:38 user nova-compute[73520]:       </nova:owner>
Aug 16 12:31:38 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:31:38 user nova-compute[73520]:       <nova:ports>
Aug 16 12:31:38 user nova-compute[73520]:         <nova:port uuid="8018c557-722c-41a7-91e0-f63bc6568bac">
Aug 16 12:31:38 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 12:31:38 user nova-compute[73520]:         </nova:port>
Aug 16 12:31:38 user nova-compute[73520]:       </nova:ports>
Aug 16 12:31:38 user nova-compute[73520]:     </nova:instance>
Aug 16 12:31:38 user nova-compute[73520]:   </metadata>
Aug 16 12:31:38 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:31:38 user nova-compute[73520]:     <system>
Aug 16 12:31:38 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:31:38 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:31:38 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:31:38 user nova-compute[73520]:       <entry name="serial">27659935-6eb3-4cea-9648-f5820cddda98</entry>
Aug 16 12:31:38 user nova-compute[73520]:       <entry name="uuid">27659935-6eb3-4cea-9648-f5820cddda98</entry>
Aug 16 12:31:38 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:31:38 user nova-compute[73520]:     </system>
Aug 16 12:31:38 user nova-compute[73520]:   </sysinfo>
Aug 16 12:31:38 user nova-compute[73520]:   <os>
Aug 16 12:31:38 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:31:38 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:31:38 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:31:38 user nova-compute[73520]:   </os>
Aug 16 12:31:38 user nova-compute[73520]:   <features>
Aug 16 12:31:38 user nova-compute[73520]:     <acpi/>
Aug 16 12:31:38 user nova-compute[73520]:     <apic/>
Aug 16 12:31:38 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:31:38 user nova-compute[73520]:   </features>
Aug 16 12:31:38 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:31:38 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:31:38 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:31:38 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:31:38 user nova-compute[73520]:   </clock>
Aug 16 12:31:38 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:31:38 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:31:38 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:31:38 user nova-compute[73520]:   </cpu>
Aug 16 12:31:38 user nova-compute[73520]:   <devices>
Aug 16 12:31:38 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:31:38 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:31:38 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk"/>
Aug 16 12:31:38 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:31:38 user nova-compute[73520]:     </disk>
Aug 16 12:31:38 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:31:38 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:31:38 user nova-compute[73520]:       <source dev="/dev/sde"/>
Aug 16 12:31:38 user nova-compute[73520]:       <target dev="vdb" bus="virtio"/>
Aug 16 12:31:38 user nova-compute[73520]:       <serial>ccfc736d-08db-4664-b12e-9955e4fc00f7</serial>
Aug 16 12:31:38 user nova-compute[73520]:     </disk>
Aug 16 12:31:38 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:31:38 user nova-compute[73520]:       <mac address="fa:16:3e:e5:78:5d"/>
Aug 16 12:31:38 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:31:38 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:31:38 user nova-compute[73520]:       <target dev="tap8018c557-72"/>
Aug 16 12:31:38 user nova-compute[73520]:     </interface>
Aug 16 12:31:38 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:31:38 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/console.log" append="off"/>
Aug 16 12:31:38 user nova-compute[73520]:     </serial>
Aug 16 12:31:38 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:31:38 user nova-compute[73520]:     <video>
Aug 16 12:31:38 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:31:38 user nova-compute[73520]:     </video>
Aug 16 12:31:38 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:31:38 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:31:38 user nova-compute[73520]:     </rng>
Aug 16 12:31:38 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:31:38 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:31:38 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:31:38 user nova-compute[73520]:     </memballoon>
Aug 16 12:31:38 user nova-compute[73520]:   </devices>
Aug 16 12:31:38 user nova-compute[73520]: </domain>
Aug 16 12:31:38 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:25:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-576632488',display_name='tempest-ServerActionsTestOtherB-server-576632488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-576632488',id=34,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa+wt9FJevF0VcG5IW9UPpcwllZecsxipO+cOwPONy0JXrxwIIn5VueYzwt5Y4Fz26HPB5B2yhLRiuQ1H/JJF0RqBlDYiGwQFxVVbFuKbbBpDS5B0RYzbNj/n52YCPO2A==',key_name='tempest-keypair-872928149',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='65805b8eab71460caf571e52648c40d4',ramdisk_id='',reservation_id='r-54clw1uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1849139886',owner_user_name='tempest-ServerActionsTestOtherB-1849139886-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:31:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='354985a41cf846dab967f7d238e19319',uuid=27659935-6eb3-4cea-9648-f5820cddda98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converting VIF {"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG os_vif [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8018c557-72, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8018c557-72, col_values=(('external_ids', {'iface-id': '8018c557-722c-41a7-91e0-f63bc6568bac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:78:5d', 'vm-uuid': '27659935-6eb3-4cea-9648-f5820cddda98'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:31:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:38 user nova-compute[73520]: INFO os_vif [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72')
Aug 16 12:31:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-1ce07df1-9e0b-455a-8918-b6d606e4c41b req-f9cd516d-46c4-4572-8422-dcb757d3f129 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:31:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1ce07df1-9e0b-455a-8918-b6d606e4c41b req-f9cd516d-46c4-4572-8422-dcb757d3f129 service nova] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1ce07df1-9e0b-455a-8918-b6d606e4c41b req-f9cd516d-46c4-4572-8422-dcb757d3f129 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1ce07df1-9e0b-455a-8918-b6d606e4c41b req-f9cd516d-46c4-4572-8422-dcb757d3f129 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-1ce07df1-9e0b-455a-8918-b6d606e4c41b req-f9cd516d-46c4-4572-8422-dcb757d3f129 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] No waiting events found dispatching network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:31:39 user nova-compute[73520]: WARNING nova.compute.manager [req-1ce07df1-9e0b-455a-8918-b6d606e4c41b req-f9cd516d-46c4-4572-8422-dcb757d3f129 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received unexpected event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac for instance with vm_state resized and task_state resize_reverting.
Aug 16 12:31:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:40 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:31:40 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:31:40 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:31:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:31:41 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189101.5781095, 27659935-6eb3-4cea-9648-f5820cddda98 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:31:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] VM Resumed (Lifecycle Event)
Aug 16 12:31:41 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Instance running successfully.
Aug 16 12:31:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] finish_revert_migration finished successfully. {{(pid=73520) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 16 12:31:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-3508c014-8cc6-4d91-855e-bcae42bfc9d7 req-e9d3aed4-6f94-4c09-948a-cf8cf84f6b98 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:31:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3508c014-8cc6-4d91-855e-bcae42bfc9d7 req-e9d3aed4-6f94-4c09-948a-cf8cf84f6b98 service nova] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3508c014-8cc6-4d91-855e-bcae42bfc9d7 req-e9d3aed4-6f94-4c09-948a-cf8cf84f6b98 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-3508c014-8cc6-4d91-855e-bcae42bfc9d7 req-e9d3aed4-6f94-4c09-948a-cf8cf84f6b98 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:41 user nova-compute[73520]: DEBUG nova.compute.manager [req-3508c014-8cc6-4d91-855e-bcae42bfc9d7 req-e9d3aed4-6f94-4c09-948a-cf8cf84f6b98 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] No waiting events found dispatching network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:31:41 user nova-compute[73520]: WARNING nova.compute.manager [req-3508c014-8cc6-4d91-855e-bcae42bfc9d7 req-e9d3aed4-6f94-4c09-948a-cf8cf84f6b98 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received unexpected event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac for instance with vm_state resized and task_state resize_reverting.
Aug 16 12:31:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:31:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:31:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 12:31:41 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189101.5793118, 27659935-6eb3-4cea-9648-f5820cddda98 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:31:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] VM Started (Lifecycle Event)
Aug 16 12:31:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:31:41 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:31:41 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 12:31:41 user nova-compute[73520]: INFO nova.compute.manager [None req-4120e5d3-0c56-4b1b-8b03-ef8622b4bc3b tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating instance to original state: 'active'
Aug 16 12:31:41 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:31:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:31:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:31:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-1d912da2-361d-4977-aeaf-47e89eed12bd req-6f945368-6a57-44c4-8fcf-2d523c14899b service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Received event network-changed-721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:31:43 user nova-compute[73520]: DEBUG nova.compute.manager [req-1d912da2-361d-4977-aeaf-47e89eed12bd req-6f945368-6a57-44c4-8fcf-2d523c14899b service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Refreshing instance network info cache due to event network-changed-721a7b26-4adf-4711-b0df-6842b589bb78. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:31:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1d912da2-361d-4977-aeaf-47e89eed12bd req-6f945368-6a57-44c4-8fcf-2d523c14899b service nova] Acquiring lock "refresh_cache-31c878ee-ff2c-42ff-aa73-453e7d47c6f9" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:31:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1d912da2-361d-4977-aeaf-47e89eed12bd req-6f945368-6a57-44c4-8fcf-2d523c14899b service nova] Acquired lock "refresh_cache-31c878ee-ff2c-42ff-aa73-453e7d47c6f9" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:31:43 user nova-compute[73520]: DEBUG nova.network.neutron [req-1d912da2-361d-4977-aeaf-47e89eed12bd req-6f945368-6a57-44c4-8fcf-2d523c14899b service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Refreshing network info cache for port 721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:31:43 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:31:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:44 user nova-compute[73520]: DEBUG nova.network.neutron [req-1d912da2-361d-4977-aeaf-47e89eed12bd req-6f945368-6a57-44c4-8fcf-2d523c14899b service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Updated VIF entry in instance network info cache for port 721a7b26-4adf-4711-b0df-6842b589bb78. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:31:44 user nova-compute[73520]: DEBUG nova.network.neutron [req-1d912da2-361d-4977-aeaf-47e89eed12bd req-6f945368-6a57-44c4-8fcf-2d523c14899b service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Updating instance_info_cache with network_info: [{"id": "721a7b26-4adf-4711-b0df-6842b589bb78", "address": "fa:16:3e:e3:da:c9", "network": {"id": "e257644d-4e85-47bb-99ad-249afdcbfa5b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-376827404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d16aba93c82b40f08bc0558754584c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721a7b26-4a", "ovs_interfaceid": "721a7b26-4adf-4711-b0df-6842b589bb78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:31:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1d912da2-361d-4977-aeaf-47e89eed12bd req-6f945368-6a57-44c4-8fcf-2d523c14899b service nova] Releasing lock "refresh_cache-31c878ee-ff2c-42ff-aa73-453e7d47c6f9" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:31:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:31:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:31:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:46 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:31:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG nova.objects.instance [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lazy-loading 'flavor' on Instance uuid 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:49 user nova-compute[73520]: INFO nova.compute.manager [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Attaching volume d1cf22ad-ba1e-4834-8a73-4d8a1911681a to /dev/vdb
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG os_brick.utils [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ecb8ee-d3da-4c1f-95a4-554e8fa042f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[300b0fe7-37cc-4c96-ba6d-37e05bc6e331]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[871bd26e-02ef-4b61-8e4b-47efb66274f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[428471f5-9c91-4c03-aa3e-44f7e1bb8b8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:31:49 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a306f83c-a468-4d6b-860c-e81ed744d62f]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG os_brick.utils [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] <== get_connector_properties: return (249ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Updating existing volume attachment record: 44a5e136-c743-4a5a-8f6c-0d2899392b7d {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:31:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:31:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:31:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:31:51 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:31:51 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7237MB free_disk=25.126388549804688GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d712e605-8ee2-4bd5-adce-61d0f284c835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 27659935-6eb3-4cea-9648-f5820cddda98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 25b02048-2937-440a-9809-eceeb3558856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 52275f84-b38b-4351-befe-9052b1e02612 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1a8276cb-495e-4e55-aa8b-02b18118b51e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ce0355be-8b0e-4c8c-b052-10ac730fa6cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:31:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:31:52 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:31:52 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:31:52 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:31:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:31:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:31:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:31:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:31:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:31:54 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:31:54 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 443357b7-2fc9-4ac7-8fce-7dc2bede4369 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:55 user nova-compute[73520]: INFO nova.compute.manager [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Terminating instance
Aug 16 12:31:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updating instance_info_cache with network_info: [{"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-443357b7-2fc9-4ac7-8fce-7dc2bede4369" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG nova.compute.manager [req-4bb107ae-890f-48cf-ad70-d69b6baf567f req-98d47d83-ea0d-42cf-973c-dd57973893e6 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Received event network-vif-unplugged-ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4bb107ae-890f-48cf-ad70-d69b6baf567f req-98d47d83-ea0d-42cf-973c-dd57973893e6 service nova] Acquiring lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4bb107ae-890f-48cf-ad70-d69b6baf567f req-98d47d83-ea0d-42cf-973c-dd57973893e6 service nova] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4bb107ae-890f-48cf-ad70-d69b6baf567f req-98d47d83-ea0d-42cf-973c-dd57973893e6 service nova] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG nova.compute.manager [req-4bb107ae-890f-48cf-ad70-d69b6baf567f req-98d47d83-ea0d-42cf-973c-dd57973893e6 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] No waiting events found dispatching network-vif-unplugged-ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG nova.compute.manager [req-4bb107ae-890f-48cf-ad70-d69b6baf567f req-98d47d83-ea0d-42cf-973c-dd57973893e6 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Received event network-vif-unplugged-ec555ffc-ecb2-48d7-8c11-d07a3238df5a for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:31:55 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Instance destroyed successfully.
Aug 16 12:31:55 user nova-compute[73520]: DEBUG nova.objects.instance [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lazy-loading 'resources' on Instance uuid 443357b7-2fc9-4ac7-8fce-7dc2bede4369 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1044531346',display_name='tempest-ServerActionsTestOtherA-server-1044531346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1044531346',id=3,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl3ev6edzI1KLHo1Y5B96ptBm6NSqIbcBOFcMZceXonYnWR3AckvFat7GQrt1EQ+8fQAGMP/p7GDPbXyfJwBrIOn5y+eKTCEQMF2Y9CFOeelDTAPhe+VbqGs9Aw6sueMA==',key_name='tempest-keypair-2118649879',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:12:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57dd566104a645fd8abda43da8d9b980',ramdisk_id='',reservation_id='r-cy2juzvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-294187005',owner_user_name='tempest-ServerActionsTestOtherA-294187005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2495e37a99546deb000789aac42ed34',uuid=443357b7-2fc9-4ac7-8fce-7dc2bede4369,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converting VIF {"id": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "address": "fa:16:3e:e4:80:85", "network": {"id": "5359a7cc-ec34-4ae4-8677-6a1f55567e21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2094819446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57dd566104a645fd8abda43da8d9b980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec555ffc-ec", "ovs_interfaceid": "ec555ffc-ecb2-48d7-8c11-d07a3238df5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:80:85,bridge_name='br-int',has_traffic_filtering=True,id=ec555ffc-ecb2-48d7-8c11-d07a3238df5a,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec555ffc-ec') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG os_vif [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:80:85,bridge_name='br-int',has_traffic_filtering=True,id=ec555ffc-ecb2-48d7-8c11-d07a3238df5a,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec555ffc-ec') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec555ffc-ec, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:55 user nova-compute[73520]: INFO os_vif [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:80:85,bridge_name='br-int',has_traffic_filtering=True,id=ec555ffc-ecb2-48d7-8c11-d07a3238df5a,network=Network(5359a7cc-ec34-4ae4-8677-6a1f55567e21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec555ffc-ec')
Aug 16 12:31:55 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Deleting instance files /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369_del
Aug 16 12:31:55 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Deletion of /opt/stack/data/nova/instances/443357b7-2fc9-4ac7-8fce-7dc2bede4369_del complete
Aug 16 12:31:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:31:56 user nova-compute[73520]: INFO nova.compute.manager [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 16 12:31:56 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:31:56 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:31:56 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:31:56 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:31:56 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Took 0.87 seconds to deallocate network for instance.
Aug 16 12:31:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-9b1db128-b119-43d8-8848-5f409dcc354a req-8200dd0e-5bc6-41ff-a8d6-c60fff28fbd7 service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Received event network-vif-deleted-ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:31:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:57 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:31:57 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:31:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:57 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Deleted allocations for instance 443357b7-2fc9-4ac7-8fce-7dc2bede4369
Aug 16 12:31:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-bf7ae5d0-19a6-4fc9-b02b-57e1fb0ab93e req-c1b535aa-79d8-47ed-8848-5ed1b1c1ed5b service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Received event network-vif-plugged-ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:31:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bf7ae5d0-19a6-4fc9-b02b-57e1fb0ab93e req-c1b535aa-79d8-47ed-8848-5ed1b1c1ed5b service nova] Acquiring lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:31:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bf7ae5d0-19a6-4fc9-b02b-57e1fb0ab93e req-c1b535aa-79d8-47ed-8848-5ed1b1c1ed5b service nova] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:31:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bf7ae5d0-19a6-4fc9-b02b-57e1fb0ab93e req-c1b535aa-79d8-47ed-8848-5ed1b1c1ed5b service nova] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-bf7ae5d0-19a6-4fc9-b02b-57e1fb0ab93e req-c1b535aa-79d8-47ed-8848-5ed1b1c1ed5b service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] No waiting events found dispatching network-vif-plugged-ec555ffc-ecb2-48d7-8c11-d07a3238df5a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:31:57 user nova-compute[73520]: WARNING nova.compute.manager [req-bf7ae5d0-19a6-4fc9-b02b-57e1fb0ab93e req-c1b535aa-79d8-47ed-8848-5ed1b1c1ed5b service nova] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Received unexpected event network-vif-plugged-ec555ffc-ecb2-48d7-8c11-d07a3238df5a for instance with vm_state deleted and task_state None.
Aug 16 12:31:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-732e9fab-825c-4571-a48a-3aaa43c5452d tempest-ServerActionsTestOtherA-294187005 tempest-ServerActionsTestOtherA-294187005-project-member] Lock "443357b7-2fc9-4ac7-8fce-7dc2bede4369" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.555s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:31:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG nova.compute.manager [req-a364de0c-159c-4aa3-9b17-204210f94628 req-df7ebdf7-4225-4e7c-b953-b120d5cefbd2 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-changed-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG nova.compute.manager [req-a364de0c-159c-4aa3-9b17-204210f94628 req-df7ebdf7-4225-4e7c-b953-b120d5cefbd2 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Refreshing instance network info cache due to event network-changed-53e90722-ef5f-49c8-b2b9-09ecaa2667d8. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a364de0c-159c-4aa3-9b17-204210f94628 req-df7ebdf7-4225-4e7c-b953-b120d5cefbd2 service nova] Acquiring lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a364de0c-159c-4aa3-9b17-204210f94628 req-df7ebdf7-4225-4e7c-b953-b120d5cefbd2 service nova] Acquired lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG nova.network.neutron [req-a364de0c-159c-4aa3-9b17-204210f94628 req-df7ebdf7-4225-4e7c-b953-b120d5cefbd2 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Refreshing network info cache for port 53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWyoTZJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:32:01 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:32:01 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:32:01 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9812989-e1cc-43fd-b291-e4fb28bec884]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:32:01 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0039497c-934e-434f-a3ef-16735ce0fe15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a] added
Aug 16 12:32:01 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ad0cf7-4ef7-4d5e-99fb-caee83d62d55]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05200dc-13d7-4af2-a45d-c9b943990196]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CWyoTZJi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CWyoTZJi" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6057ce-d826-4997-ae44-919d5809e8fb]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CWyoTZJi'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[57329530-64b8-40e9-854d-c9e5d9120968]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "25b02048-2937-440a-9809-eceeb3558856" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[980f68b9-f479-4c03-b8d1-4135513a1060]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:01 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:01 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG nova.objects.instance [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'flavor' on Instance uuid 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "25b02048-2937-440a-9809-eceeb3558856" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea8ea6-1c9d-4f84-adf5-3c58ab60f8de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a, portal: 172.16.0.220,3260]
Aug 16 12:32:01 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a, portal: 172.16.0.220,3260] successful.
Aug 16 12:32:01 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c5d599-306a-4dfc-8563-d9b4a5042993]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5619582c-9377-4031-aa20-254aa3a4579d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a (non-flash)
Aug 16 12:32:01 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:01 user nova-compute[73520]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a (non-flash)
Aug 16 12:32:01 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[890ab147-d04d-46f3-be75-d4215170261d]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWyoTZJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "25b02048-2937-440a-9809-eceeb3558856" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:01 user nova-compute[73520]: INFO nova.compute.manager [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Attaching volume acfb26b9-0616-4c76-aa80-f02f03b8e281 to /dev/vdb
Aug 16 12:32:01 user nova-compute[73520]: DEBUG os_brick.utils [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a553e117-8642-41a0-bed6-cc9113bb77fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e8d9b5-9632-41d9-adea-e531ed69228f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6784c6f-f2b4-4721-b018-252aa174a912]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f02f97c-33e4-4413-85c8-9403bb65409f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG nova.network.neutron [req-a364de0c-159c-4aa3-9b17-204210f94628 req-df7ebdf7-4225-4e7c-b953-b120d5cefbd2 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Updated VIF entry in instance network info cache for port 53e90722-ef5f-49c8-b2b9-09ecaa2667d8. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG nova.network.neutron [req-a364de0c-159c-4aa3-9b17-204210f94628 req-df7ebdf7-4225-4e7c-b953-b120d5cefbd2 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Updating instance_info_cache with network_info: [{"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:32:02 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:32:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1ccf32-2665-4bd9-a041-cec613e04cc1]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG os_brick.utils [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Updating existing volume attachment record: 2082c306-4ba4-4cb1-844c-9b49b7205482 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a364de0c-159c-4aa3-9b17-204210f94628 req-df7ebdf7-4225-4e7c-b953-b120d5cefbd2 service nova] Releasing lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23666363931656566', 'path': '/dev/sdf'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666363931656566', 'path': '/dev/sdf'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG nova.objects.instance [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lazy-loading 'flavor' on Instance uuid 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:32:02 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:32:02 user nova-compute[73520]:   <source dev="/dev/sdf"/>
Aug 16 12:32:02 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:32:02 user nova-compute[73520]:   <serial>d1cf22ad-ba1e-4834-8a73-4d8a1911681a</serial>
Aug 16 12:32:02 user nova-compute[73520]: </disk>
Aug 16 12:32:02 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:32:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:32:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:32:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] No VIF found with MAC fa:16:3e:e3:da:c9, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:32:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0b1f2979-115f-43af-a6a3-1e5ea9698f22 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.091s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:04 user nova-compute[73520]: INFO nova.compute.manager [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Rescuing
Aug 16 12:32:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "refresh_cache-52275f84-b38b-4351-befe-9052b1e02612" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:32:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquired lock "refresh_cache-52275f84-b38b-4351-befe-9052b1e02612" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:32:04 user nova-compute[73520]: DEBUG nova.network.neutron [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:32:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:04 user nova-compute[73520]: DEBUG nova.network.neutron [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Updating instance_info_cache with network_info: [{"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:32:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Releasing lock "refresh_cache-52275f84-b38b-4351-befe-9052b1e02612" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:32:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-4f920080-dba6-463a-98f4-81935a1dd9de req-bad5b193-5c86-4595-b1f9-a4f07862f21a service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-unplugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4f920080-dba6-463a-98f4-81935a1dd9de req-bad5b193-5c86-4595-b1f9-a4f07862f21a service nova] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4f920080-dba6-463a-98f4-81935a1dd9de req-bad5b193-5c86-4595-b1f9-a4f07862f21a service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4f920080-dba6-463a-98f4-81935a1dd9de req-bad5b193-5c86-4595-b1f9-a4f07862f21a service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-4f920080-dba6-463a-98f4-81935a1dd9de req-bad5b193-5c86-4595-b1f9-a4f07862f21a service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] No waiting events found dispatching network-vif-unplugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:32:05 user nova-compute[73520]: WARNING nova.compute.manager [req-4f920080-dba6-463a-98f4-81935a1dd9de req-bad5b193-5c86-4595-b1f9-a4f07862f21a service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received unexpected event network-vif-unplugged-614067cd-fd42-4bc4-8707-742fde3c1b05 for instance with vm_state active and task_state rescuing.
Aug 16 12:32:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Instance destroyed successfully.
Aug 16 12:32:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Attempting a stable device rescue
Aug 16 12:32:05 user nova-compute[73520]: INFO nova.compute.manager [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Detaching volume d1cf22ad-ba1e-4834-8a73-4d8a1911681a
Aug 16 12:32:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73520) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Instance directory exists: not creating {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 12:32:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Creating image(s)
Aug 16 12:32:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "/opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "/opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "/opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG nova.objects.instance [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 52275f84-b38b-4351-befe-9052b1e02612 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "3018ab356cf735caad3c5a1bcb9733eb6470884f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "3018ab356cf735caad3c5a1bcb9733eb6470884f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f.part --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:06 user nova-compute[73520]: INFO nova.virt.block_device [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Attempting to driver detach volume d1cf22ad-ba1e-4834-8a73-4d8a1911681a from mountpoint /dev/vdb
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Attempting to detach device vdb from instance 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:32:07 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:32:07 user nova-compute[73520]:   <source dev="/dev/sdf"/>
Aug 16 12:32:07 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:32:07 user nova-compute[73520]:   <serial>d1cf22ad-ba1e-4834-8a73-4d8a1911681a</serial>
Aug 16 12:32:07 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:32:07 user nova-compute[73520]: </disk>
Aug 16 12:32:07 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:32:07 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Successfully detached device vdb from instance 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 from the persistent domain config.
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:32:07 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:32:07 user nova-compute[73520]:   <source dev="/dev/sdf"/>
Aug 16 12:32:07 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:32:07 user nova-compute[73520]:   <serial>d1cf22ad-ba1e-4834-8a73-4d8a1911681a</serial>
Aug 16 12:32:07 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:32:07 user nova-compute[73520]: </disk>
Aug 16 12:32:07 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f.part --force-share --output=json" returned: 0 in 0.202s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.virt.images [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] e1c4b786-c6ff-48f7-9fbb-62b70e74f970 was qcow2, converting to raw {{(pid=73520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f.part /opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f.converted {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-83d86428-4833-4251-bf4a-70ef3dbb6516 req-461e8ed0-206f-423a-9554-14a625783352 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-83d86428-4833-4251-bf4a-70ef3dbb6516 req-461e8ed0-206f-423a-9554-14a625783352 service nova] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-83d86428-4833-4251-bf4a-70ef3dbb6516 req-461e8ed0-206f-423a-9554-14a625783352 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-83d86428-4833-4251-bf4a-70ef3dbb6516 req-461e8ed0-206f-423a-9554-14a625783352 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-83d86428-4833-4251-bf4a-70ef3dbb6516 req-461e8ed0-206f-423a-9554-14a625783352 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] No waiting events found dispatching network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:32:07 user nova-compute[73520]: WARNING nova.compute.manager [req-83d86428-4833-4251-bf4a-70ef3dbb6516 req-461e8ed0-206f-423a-9554-14a625783352 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received unexpected event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 for instance with vm_state active and task_state rescuing.
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692189127.4596622, 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:32:07 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Successfully detached device vdb from instance 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 from the live domain config.
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWyoTZJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:32:07 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f.part /opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f.converted" returned: 0 in 0.374s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f.converted --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8530ac-9e31-460c-814e-f82bdccbf6e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c251787b-d4a6-4ac7-b562-5fc5a854f63f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:07 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:07 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:07 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:07 user nova-compute[73520]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a (non-flash)
Aug 16 12:32:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:07 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:07 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:07 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:07 user nova-compute[73520]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a (non-flash)
Aug 16 12:32:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c121cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a'): ({'sdf'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Removing single pathed devices sdf {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fd54b4-89d3-4d53-b95d-9abb6cd0e8f2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1863712-c258-4016-8699-6fe872eb8aba]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Flushing IO for device /dev/sdf {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[625482ab-3786-4ddd-8aaf-9bf30572943e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3ffa1d-a9b1-4b51-ad80-9032a32f3e94]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] SCSI volumes sdf have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "3018ab356cf735caad3c5a1bcb9733eb6470884f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.889s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "3018ab356cf735caad3c5a1bcb9733eb6470884f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "3018ab356cf735caad3c5a1bcb9733eb6470884f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3843917b-f889-4afd-ab00-2a416e34b133]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[217bd881-5a55-4f39-9353-0148db5a2fe9]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a, portal: 172.16.0.220,3260]
Aug 16 12:32:07 user nova-compute[73520]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a, portal: 172.16.0.220,3260] successful.
Aug 16 12:32:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1cf22ad-ba1e-4834-8a73-4d8a1911681a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34daaf2-05f6-4925-86de-aad68b2d0803]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] <== disconnect_volume: return (375ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f,backing_fmt=raw /opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.rescue {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f,backing_fmt=raw /opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.rescue" returned: 0 in 0.058s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "3018ab356cf735caad3c5a1bcb9733eb6470884f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.objects.instance [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'migration_context' on Instance uuid 52275f84-b38b-4351-befe-9052b1e02612 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Start _get_guest_xml network_info=[{"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "vif_mac": "fa:16:3e:34:5b:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e1c4b786-c6ff-48f7-9fbb-62b70e74f970', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuiMDjbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '52275f84-b38b-4351-befe-9052b1e02612', 'attached_at': '', 'detached_at': '', 'volume_id': '2c685011-7645-408a-97f7-cc9c4eb58585', 'serial': '2c685011-7645-408a-97f7-cc9c4eb58585'}, 'attachment_id': '9cfc4377-c497-4b5f-b2da-ae7e86fa7fda', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:32:07 user nova-compute[73520]: DEBUG nova.objects.instance [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'resources' on Instance uuid 52275f84-b38b-4351-befe-9052b1e02612 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.objects.instance [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'numa_topology' on Instance uuid 52275f84-b38b-4351-befe-9052b1e02612 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:08 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:32:08 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.objects.instance [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 52275f84-b38b-4351-befe-9052b1e02612 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuiMDjbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:32:08 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:32:08 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:32:08 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db0db64-b7ad-4a3f-9803-f2fd609e3aca]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VuiMDjbF\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 12:32:08 user nova-compute[73520]: node.name = iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585
Aug 16 12:32:08 user nova-compute[73520]: node.tpgt = -1
Aug 16 12:32:08 user nova-compute[73520]: node.startup = automatic
Aug 16 12:32:08 user nova-compute[73520]: node.leading_login = No
Aug 16 12:32:08 user nova-compute[73520]: iface.iscsi_ifacename = default
Aug 16 12:32:08 user nova-compute[73520]: iface.net_ifacename = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.ipaddress = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.prefix_len = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.hwaddress = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.transport_name = tcp
Aug 16 12:32:08 user nova-compute[73520]: iface.initiatorname = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.state = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.vlan_id = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.vlan_priority = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.vlan_state = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.iface_num = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.mtu = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.port = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.bootproto = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.subnet_mask = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.gateway = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.dhcp_alt_client_id = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.dhcp_dns = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.dhcp_learn_iqn = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.dhcp_vendor_id_state = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.dhcp_vendor_id = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.dhcp_slp_da = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.fragmentation = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.gratuitous_arp = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.incoming_forwarding = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.tos_state = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.tos = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.ttl = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.delayed_ack = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.tcp_nagle = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.tcp_wsf_state = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.tcp_wsf = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.tcp_timer_scale = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.tcp_timestamp = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.redirect = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.def_task_mgmt_timeout = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.header_digest = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.data_digest = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.immediate_data = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.initial_r2t = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.data_seq_inorder = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.data_pdu_inorder = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.erl = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.max_receive_data_len = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.first_burst_len = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.max_outstanding_r2t = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.max_burst_len = 0
Aug 16 12:32:08 user nova-compute[73520]: iface.chap_auth = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.bidi_chap = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.strict_login_compliance = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.discovery_auth = <empty>
Aug 16 12:32:08 user nova-compute[73520]: iface.discovery_logout = <empty>
Aug 16 12:32:08 user nova-compute[73520]: node.discovery_address = <empty>
Aug 16 12:32:08 user nova-compute[73520]: node.discovery_port = 0
Aug 16 12:32:08 user nova-compute[73520]: node.discovery_type = static
Aug 16 12:32:08 user nova-compute[73520]: node.session.initial_cmdsn = 0
Aug 16 12:32:08 user nova-compute[73520]: node.session.initial_login_retry_max = 8
Aug 16 12:32:08 user nova-compute[73520]: node.session.xmit_thread_priority = -20
Aug 16 12:32:08 user nova-compute[73520]: node.session.cmds_max = 128
Aug 16 12:32:08 user nova-compute[73520]: node.session.queue_depth = 32
Aug 16 12:32:08 user nova-compute[73520]: node.session.nr_sessions = 1
Aug 16 12:32:08 user nova-compute[73520]: node.session.auth.authmethod = CHAP
Aug 16 12:32:08 user nova-compute[73520]: node.session.auth.username = VuiMDjbF
Aug 16 12:32:08 user nova-compute[73520]: node.session.auth.password = ***
Aug 16 12:32:08 user nova-compute[73520]: node.session.auth.username_in = <empty>
Aug 16 12:32:08 user nova-compute[73520]: node.session.auth.password_in = <empty>
Aug 16 12:32:08 user nova-compute[73520]: node.session.auth.chap_algs = MD5
Aug 16 12:32:08 user nova-compute[73520]: node.session.timeo.replacement_timeout = 120
Aug 16 12:32:08 user nova-compute[73520]: node.session.err_timeo.abort_timeout = 15
Aug 16 12:32:08 user nova-compute[73520]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 12:32:08 user nova-compute[73520]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 12:32:08 user nova-compute[73520]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 12:32:08 user nova-compute[73520]: node.session.iscsi.FastAbort = Yes
Aug 16 12:32:08 user nova-compute[73520]: node.session.iscsi.InitialR2T = No
Aug 16 12:32:08 user nova-compute[73520]: node.session.iscsi.ImmediateData = Yes
Aug 16 12:32:08 user nova-compute[73520]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 12:32:08 user nova-compute[73520]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 12:32:08 user nova-compute[73520]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 12:32:08 user nova-compute[73520]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 12:32:08 user nova-compute[73520]: node.session.iscsi.MaxConnections = 1
Aug 16 12:32:08 user nova-compute[73520]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 12:32:08 user nova-compute[73520]: node.session.iscsi.ERL = 0
Aug 16 12:32:08 user nova-compute[73520]: node.session.scan = manual
Aug 16 12:32:08 user nova-compute[73520]: node.session.reopen_max = 0
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].address = 172.16.0.220
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].port = 3260
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].startup = manual
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].tcp.window_size = 524288
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].tcp.type_of_service = 0
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].timeo.logout_timeout = 15
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].timeo.login_timeout = 15
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].timeo.auth_timeout = 45
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].iscsi.DataDigest = None
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].iscsi.IFMarker = No
Aug 16 12:32:08 user nova-compute[73520]: node.conn[0].iscsi.OFMarker = No
Aug 16 12:32:08 user nova-compute[73520]: # END RECORD
Aug 16 12:32:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[153502bc-ce37-4f6f-8ac3-8a16adc93ab4]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9e250c-9293-47ea-ba80-f88aa87a3940]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuiMDjbF {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuiMDjbF" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daf8358-4448-4617-a849-29f701ae6fec]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VuiMDjbF'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b5b946-cf2f-4592-a0e3-ac6a50090dff]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eb566d-43c9-4ed3-8821-da971edb2505]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:08 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:08 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:08 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:08 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:08 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:08 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] HCTL ('35', '0', '0', 0) found on session 41 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[632a4e99-12df-4ab0-9e73-101d2fa98fec]: (4, ('0 0 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Searching for a device in session 41 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuiMDjbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.193s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] <== connect_volume: return (195ms) {'type': 'block', 'scsi_wwn': '26662323132353363', 'path': '/dev/sdd'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662323132353363', 'path': '/dev/sdd'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1383144430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1383144430',id=39,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:30:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-6nnhz2wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:30:42Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=52275f84-b38b-4351-befe-9052b1e02612,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "vif_mac": "fa:16:3e:34:5b:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "vif_mac": "fa:16:3e:34:5b:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:5b:9f,bridge_name='br-int',has_traffic_filtering=True,id=614067cd-fd42-4bc4-8707-742fde3c1b05,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614067cd-fd') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.objects.instance [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'pci_devices' on Instance uuid 52275f84-b38b-4351-befe-9052b1e02612 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:32:08 user nova-compute[73520]:   <uuid>52275f84-b38b-4351-befe-9052b1e02612</uuid>
Aug 16 12:32:08 user nova-compute[73520]:   <name>instance-00000027</name>
Aug 16 12:32:08 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:32:08 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:32:08 user nova-compute[73520]:   <metadata>
Aug 16 12:32:08 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:32:08 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:32:08 user nova-compute[73520]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1383144430</nova:name>
Aug 16 12:32:08 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:32:08</nova:creationTime>
Aug 16 12:32:08 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:32:08 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:32:08 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:32:08 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:32:08 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:32:08 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:32:08 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:32:08 user nova-compute[73520]:       <nova:owner>
Aug 16 12:32:08 user nova-compute[73520]:         <nova:user uuid="3d1e9417253f43b482e8ee5b3109a697">tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member</nova:user>
Aug 16 12:32:08 user nova-compute[73520]:         <nova:project uuid="4d3756b80f2243dca0b31ffea7438b5d">tempest-ServerBootFromVolumeStableRescueTest-1104312883</nova:project>
Aug 16 12:32:08 user nova-compute[73520]:       </nova:owner>
Aug 16 12:32:08 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:32:08 user nova-compute[73520]:       <nova:ports>
Aug 16 12:32:08 user nova-compute[73520]:         <nova:port uuid="614067cd-fd42-4bc4-8707-742fde3c1b05">
Aug 16 12:32:08 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 12:32:08 user nova-compute[73520]:         </nova:port>
Aug 16 12:32:08 user nova-compute[73520]:       </nova:ports>
Aug 16 12:32:08 user nova-compute[73520]:     </nova:instance>
Aug 16 12:32:08 user nova-compute[73520]:   </metadata>
Aug 16 12:32:08 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:32:08 user nova-compute[73520]:     <system>
Aug 16 12:32:08 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:32:08 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:32:08 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:32:08 user nova-compute[73520]:       <entry name="serial">52275f84-b38b-4351-befe-9052b1e02612</entry>
Aug 16 12:32:08 user nova-compute[73520]:       <entry name="uuid">52275f84-b38b-4351-befe-9052b1e02612</entry>
Aug 16 12:32:08 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:32:08 user nova-compute[73520]:     </system>
Aug 16 12:32:08 user nova-compute[73520]:   </sysinfo>
Aug 16 12:32:08 user nova-compute[73520]:   <os>
Aug 16 12:32:08 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:32:08 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:32:08 user nova-compute[73520]:   </os>
Aug 16 12:32:08 user nova-compute[73520]:   <features>
Aug 16 12:32:08 user nova-compute[73520]:     <acpi/>
Aug 16 12:32:08 user nova-compute[73520]:     <apic/>
Aug 16 12:32:08 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:32:08 user nova-compute[73520]:   </features>
Aug 16 12:32:08 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:32:08 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:32:08 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:32:08 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:32:08 user nova-compute[73520]:   </clock>
Aug 16 12:32:08 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:32:08 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:32:08 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:32:08 user nova-compute[73520]:   </cpu>
Aug 16 12:32:08 user nova-compute[73520]:   <devices>
Aug 16 12:32:08 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:32:08 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:32:08 user nova-compute[73520]:       <source dev="/dev/sdd"/>
Aug 16 12:32:08 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:32:08 user nova-compute[73520]:       <serial>2c685011-7645-408a-97f7-cc9c4eb58585</serial>
Aug 16 12:32:08 user nova-compute[73520]:     </disk>
Aug 16 12:32:08 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:32:08 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:32:08 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.rescue"/>
Aug 16 12:32:08 user nova-compute[73520]:       <target dev="vdb" bus="virtio"/>
Aug 16 12:32:08 user nova-compute[73520]:       <boot order="1"/>
Aug 16 12:32:08 user nova-compute[73520]:     </disk>
Aug 16 12:32:08 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:32:08 user nova-compute[73520]:       <mac address="fa:16:3e:34:5b:9f"/>
Aug 16 12:32:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:32:08 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:32:08 user nova-compute[73520]:       <target dev="tap614067cd-fd"/>
Aug 16 12:32:08 user nova-compute[73520]:     </interface>
Aug 16 12:32:08 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:32:08 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/console.log" append="off"/>
Aug 16 12:32:08 user nova-compute[73520]:     </serial>
Aug 16 12:32:08 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:32:08 user nova-compute[73520]:     <video>
Aug 16 12:32:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:32:08 user nova-compute[73520]:     </video>
Aug 16 12:32:08 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:32:08 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:32:08 user nova-compute[73520]:     </rng>
Aug 16 12:32:08 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:32:08 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:32:08 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:32:08 user nova-compute[73520]:     </memballoon>
Aug 16 12:32:08 user nova-compute[73520]:   </devices>
Aug 16 12:32:08 user nova-compute[73520]: </domain>
Aug 16 12:32:08 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:32:08 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Instance destroyed successfully.
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] No VIF found with MAC fa:16:3e:34:5b:9f, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG nova.objects.instance [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lazy-loading 'flavor' on Instance uuid 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-685f7614-6e6d-411e-8d95-7a51f567d275 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.006s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-bd0532bd-eabf-4d2c-9dfa-48e45e691f06 req-f28cc310-5d07-4dfe-b760-bb9583bdd7c4 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:32:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bd0532bd-eabf-4d2c-9dfa-48e45e691f06 req-f28cc310-5d07-4dfe-b760-bb9583bdd7c4 service nova] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bd0532bd-eabf-4d2c-9dfa-48e45e691f06 req-f28cc310-5d07-4dfe-b760-bb9583bdd7c4 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bd0532bd-eabf-4d2c-9dfa-48e45e691f06 req-f28cc310-5d07-4dfe-b760-bb9583bdd7c4 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-bd0532bd-eabf-4d2c-9dfa-48e45e691f06 req-f28cc310-5d07-4dfe-b760-bb9583bdd7c4 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] No waiting events found dispatching network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:32:10 user nova-compute[73520]: WARNING nova.compute.manager [req-bd0532bd-eabf-4d2c-9dfa-48e45e691f06 req-f28cc310-5d07-4dfe-b760-bb9583bdd7c4 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received unexpected event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 for instance with vm_state active and task_state rescuing.
Aug 16 12:32:10 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189115.7896652, 443357b7-2fc9-4ac7-8fce-7dc2bede4369 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:32:10 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] VM Stopped (Lifecycle Event)
Aug 16 12:32:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cacac9a8-f1b9-4715-a946-d682619d9aed None None] [instance: 443357b7-2fc9-4ac7-8fce-7dc2bede4369] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:32:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-af8af3c4-33a5-471a-9351-4754176b5d69 req-8e4e8298-7c12-475e-86f3-b88682f978cb service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:32:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-af8af3c4-33a5-471a-9351-4754176b5d69 req-8e4e8298-7c12-475e-86f3-b88682f978cb service nova] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-af8af3c4-33a5-471a-9351-4754176b5d69 req-8e4e8298-7c12-475e-86f3-b88682f978cb service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-af8af3c4-33a5-471a-9351-4754176b5d69 req-8e4e8298-7c12-475e-86f3-b88682f978cb service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-af8af3c4-33a5-471a-9351-4754176b5d69 req-8e4e8298-7c12-475e-86f3-b88682f978cb service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] No waiting events found dispatching network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:32:12 user nova-compute[73520]: WARNING nova.compute.manager [req-af8af3c4-33a5-471a-9351-4754176b5d69 req-8e4e8298-7c12-475e-86f3-b88682f978cb service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received unexpected event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 for instance with vm_state active and task_state rescuing.
Aug 16 12:32:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Removed pending event for 52275f84-b38b-4351-befe-9052b1e02612 due to event {{(pid=73520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 12:32:12 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189132.4004316, 52275f84-b38b-4351-befe-9052b1e02612 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:32:12 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] VM Resumed (Lifecycle Event)
Aug 16 12:32:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-41d020dd-ac9a-41c0-a567-d58c35916b89 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:32:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:32:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:32:12 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 12:32:12 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189132.4008846, 52275f84-b38b-4351-befe-9052b1e02612 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:32:12 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] VM Started (Lifecycle Event)
Aug 16 12:32:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:32:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhfvNzxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:32:13 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:32:13 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:32:13 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efecfda-55d8-4eb6-a0f2-8f210079126e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:32:13 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45d9458-f64a-4395-9052-6bdab25b9f5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281] added
Aug 16 12:32:13 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbad6df5-f374-4577-9c8a-802724bd0ea8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c6a880-7554-494c-98aa-3068ecdf870b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhfvNzxQ {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KhfvNzxQ" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9f45ff-98f5-412f-8692-270d5b956c4c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KhfvNzxQ'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[954544c8-589d-4d4f-9d7f-d79cce91cd09]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a999d2-5d82-4aab-9b0c-1c83e02bae62]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:13 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:13 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[048c3f41-10a7-40f1-9e21-27b55514344a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281, portal: 172.16.0.220,3260]
Aug 16 12:32:13 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281, portal: 172.16.0.220,3260] successful.
Aug 16 12:32:13 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[798e1248-8a80-43cf-b2ae-53081189c25c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b835d833-7571-4d97-bf73-a8e300bd4f03]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:32:13 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:13 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:32:13 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77d5b4e-a454-4d7c-acda-af399423016a]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:32:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhfvNzxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:32:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:32:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23839393537303563', 'path': '/dev/sdf'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:32:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839393537303563', 'path': '/dev/sdf'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:32:14 user nova-compute[73520]: DEBUG nova.objects.instance [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'flavor' on Instance uuid 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:32:14 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:32:14 user nova-compute[73520]:   <source dev="/dev/sdf"/>
Aug 16 12:32:14 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:32:14 user nova-compute[73520]:   <serial>acfb26b9-0616-4c76-aa80-f02f03b8e281</serial>
Aug 16 12:32:14 user nova-compute[73520]: </disk>
Aug 16 12:32:14 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:32:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:32:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:32:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No VIF found with MAC fa:16:3e:c2:11:90, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:32:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-49650368-391c-4c4c-8055-0c140a8bc1f3 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "25b02048-2937-440a-9809-eceeb3558856" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.484s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:16 user nova-compute[73520]: INFO nova.compute.manager [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Rescuing
Aug 16 12:32:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:32:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquired lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:32:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Updating instance_info_cache with network_info: [{"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Releasing lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-42373f94-ce4b-4047-a06f-cf6e61d83364 req-c0225b38-bc35-4fb1-84f9-ed157ccf215d service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-unplugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-42373f94-ce4b-4047-a06f-cf6e61d83364 req-c0225b38-bc35-4fb1-84f9-ed157ccf215d service nova] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-42373f94-ce4b-4047-a06f-cf6e61d83364 req-c0225b38-bc35-4fb1-84f9-ed157ccf215d service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-42373f94-ce4b-4047-a06f-cf6e61d83364 req-c0225b38-bc35-4fb1-84f9-ed157ccf215d service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-42373f94-ce4b-4047-a06f-cf6e61d83364 req-c0225b38-bc35-4fb1-84f9-ed157ccf215d service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] No waiting events found dispatching network-vif-unplugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:32:17 user nova-compute[73520]: WARNING nova.compute.manager [req-42373f94-ce4b-4047-a06f-cf6e61d83364 req-c0225b38-bc35-4fb1-84f9-ed157ccf215d service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received unexpected event network-vif-unplugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 for instance with vm_state active and task_state rescuing.
Aug 16 12:32:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:17 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 25b02048-2937-440a-9809-eceeb3558856] Instance destroyed successfully.
Aug 16 12:32:17 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Attempting rescue
Aug 16 12:32:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73520) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Instance directory exists: not creating {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 12:32:17 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Creating image(s)
Aug 16 12:32:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "/opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "/opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "/opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG nova.objects.instance [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.rescue {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.rescue" returned: 0 in 0.058s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.objects.instance [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'migration_context' on Instance uuid 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Start _get_guest_xml network_info=[{"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "vif_mac": "fa:16:3e:c2:11:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.objects.instance [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'resources' on Instance uuid 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.objects.instance [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'numa_topology' on Instance uuid 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:18 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:32:18 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.objects.instance [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1961434269',display_name='tempest-ServerRescueNegativeTestJSON-server-1961434269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1961434269',id=38,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/RNXMMAE6Nph8fr40EWI8DA2vqJl1a7Tx5xgfI37ZS3iKYbKFVFDMfz8BRbL3rjE3RFbrWS1JU5JZI5jkyrlHh+n7SlBJyNgsnXpezEuggqqGA9pismjrTTMnP74Mvdw==',key_name='tempest-keypair-1410904948',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:30:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930fb7964e2942c88c3416be172c6884',ramdisk_id='',reservation_id='r-27j4rxm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-863509458',owner_user_name='tempest-ServerRescueNegativeTestJSON-863509458-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d351d0adad3463ebb2e6917a5f91920',uuid=25b02048-2937-440a-9809-eceeb3558856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "vif_mac": "fa:16:3e:c2:11:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converting VIF {"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "vif_mac": "fa:16:3e:c2:11:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:11:90,bridge_name='br-int',has_traffic_filtering=True,id=53e90722-ef5f-49c8-b2b9-09ecaa2667d8,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e90722-ef') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.objects.instance [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'pci_devices' on Instance uuid 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:32:18 user nova-compute[73520]:   <uuid>25b02048-2937-440a-9809-eceeb3558856</uuid>
Aug 16 12:32:18 user nova-compute[73520]:   <name>instance-00000026</name>
Aug 16 12:32:18 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:32:18 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:32:18 user nova-compute[73520]:   <metadata>
Aug 16 12:32:18 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:32:18 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:32:18 user nova-compute[73520]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1961434269</nova:name>
Aug 16 12:32:18 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:32:18</nova:creationTime>
Aug 16 12:32:18 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:32:18 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:32:18 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:32:18 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:32:18 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:32:18 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:32:18 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:32:18 user nova-compute[73520]:       <nova:owner>
Aug 16 12:32:18 user nova-compute[73520]:         <nova:user uuid="0d351d0adad3463ebb2e6917a5f91920">tempest-ServerRescueNegativeTestJSON-863509458-project-member</nova:user>
Aug 16 12:32:18 user nova-compute[73520]:         <nova:project uuid="930fb7964e2942c88c3416be172c6884">tempest-ServerRescueNegativeTestJSON-863509458</nova:project>
Aug 16 12:32:18 user nova-compute[73520]:       </nova:owner>
Aug 16 12:32:18 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:32:18 user nova-compute[73520]:       <nova:ports>
Aug 16 12:32:18 user nova-compute[73520]:         <nova:port uuid="53e90722-ef5f-49c8-b2b9-09ecaa2667d8">
Aug 16 12:32:18 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 12:32:18 user nova-compute[73520]:         </nova:port>
Aug 16 12:32:18 user nova-compute[73520]:       </nova:ports>
Aug 16 12:32:18 user nova-compute[73520]:     </nova:instance>
Aug 16 12:32:18 user nova-compute[73520]:   </metadata>
Aug 16 12:32:18 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:32:18 user nova-compute[73520]:     <system>
Aug 16 12:32:18 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:32:18 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:32:18 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:32:18 user nova-compute[73520]:       <entry name="serial">25b02048-2937-440a-9809-eceeb3558856</entry>
Aug 16 12:32:18 user nova-compute[73520]:       <entry name="uuid">25b02048-2937-440a-9809-eceeb3558856</entry>
Aug 16 12:32:18 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:32:18 user nova-compute[73520]:     </system>
Aug 16 12:32:18 user nova-compute[73520]:   </sysinfo>
Aug 16 12:32:18 user nova-compute[73520]:   <os>
Aug 16 12:32:18 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:32:18 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:32:18 user nova-compute[73520]:   </os>
Aug 16 12:32:18 user nova-compute[73520]:   <features>
Aug 16 12:32:18 user nova-compute[73520]:     <acpi/>
Aug 16 12:32:18 user nova-compute[73520]:     <apic/>
Aug 16 12:32:18 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:32:18 user nova-compute[73520]:   </features>
Aug 16 12:32:18 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:32:18 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:32:18 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:32:18 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:32:18 user nova-compute[73520]:   </clock>
Aug 16 12:32:18 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:32:18 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:32:18 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:32:18 user nova-compute[73520]:   </cpu>
Aug 16 12:32:18 user nova-compute[73520]:   <devices>
Aug 16 12:32:18 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:32:18 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:32:18 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.rescue"/>
Aug 16 12:32:18 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:32:18 user nova-compute[73520]:     </disk>
Aug 16 12:32:18 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:32:18 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:32:18 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk"/>
Aug 16 12:32:18 user nova-compute[73520]:       <target dev="vdb" bus="virtio"/>
Aug 16 12:32:18 user nova-compute[73520]:     </disk>
Aug 16 12:32:18 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:32:18 user nova-compute[73520]:       <mac address="fa:16:3e:c2:11:90"/>
Aug 16 12:32:18 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:32:18 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:32:18 user nova-compute[73520]:       <target dev="tap53e90722-ef"/>
Aug 16 12:32:18 user nova-compute[73520]:     </interface>
Aug 16 12:32:18 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:32:18 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/console.log" append="off"/>
Aug 16 12:32:18 user nova-compute[73520]:     </serial>
Aug 16 12:32:18 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:32:18 user nova-compute[73520]:     <video>
Aug 16 12:32:18 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:32:18 user nova-compute[73520]:     </video>
Aug 16 12:32:18 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:32:18 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:32:18 user nova-compute[73520]:     </rng>
Aug 16 12:32:18 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:32:18 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:32:18 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:32:18 user nova-compute[73520]:     </memballoon>
Aug 16 12:32:18 user nova-compute[73520]:   </devices>
Aug 16 12:32:18 user nova-compute[73520]: </domain>
Aug 16 12:32:18 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:32:18 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 25b02048-2937-440a-9809-eceeb3558856] Instance destroyed successfully.
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:32:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] No VIF found with MAC fa:16:3e:c2:11:90, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:32:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-c98fcbcd-cfeb-4e87-a07b-97daff0d7e10 req-16d34e2a-4356-4f3e-9540-5c88fb2908b4 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:32:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c98fcbcd-cfeb-4e87-a07b-97daff0d7e10 req-16d34e2a-4356-4f3e-9540-5c88fb2908b4 service nova] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c98fcbcd-cfeb-4e87-a07b-97daff0d7e10 req-16d34e2a-4356-4f3e-9540-5c88fb2908b4 service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c98fcbcd-cfeb-4e87-a07b-97daff0d7e10 req-16d34e2a-4356-4f3e-9540-5c88fb2908b4 service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-c98fcbcd-cfeb-4e87-a07b-97daff0d7e10 req-16d34e2a-4356-4f3e-9540-5c88fb2908b4 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] No waiting events found dispatching network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:32:19 user nova-compute[73520]: WARNING nova.compute.manager [req-c98fcbcd-cfeb-4e87-a07b-97daff0d7e10 req-16d34e2a-4356-4f3e-9540-5c88fb2908b4 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received unexpected event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 for instance with vm_state active and task_state rescuing.
Aug 16 12:32:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-df219571-b9ad-4594-96bc-e69c0ddb6633 req-1e08dad5-78b5-4865-bd64-c894af394891 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:32:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df219571-b9ad-4594-96bc-e69c0ddb6633 req-1e08dad5-78b5-4865-bd64-c894af394891 service nova] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df219571-b9ad-4594-96bc-e69c0ddb6633 req-1e08dad5-78b5-4865-bd64-c894af394891 service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df219571-b9ad-4594-96bc-e69c0ddb6633 req-1e08dad5-78b5-4865-bd64-c894af394891 service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-df219571-b9ad-4594-96bc-e69c0ddb6633 req-1e08dad5-78b5-4865-bd64-c894af394891 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] No waiting events found dispatching network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:32:21 user nova-compute[73520]: WARNING nova.compute.manager [req-df219571-b9ad-4594-96bc-e69c0ddb6633 req-1e08dad5-78b5-4865-bd64-c894af394891 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received unexpected event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 for instance with vm_state active and task_state rescuing.
Aug 16 12:32:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-df219571-b9ad-4594-96bc-e69c0ddb6633 req-1e08dad5-78b5-4865-bd64-c894af394891 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:32:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df219571-b9ad-4594-96bc-e69c0ddb6633 req-1e08dad5-78b5-4865-bd64-c894af394891 service nova] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df219571-b9ad-4594-96bc-e69c0ddb6633 req-1e08dad5-78b5-4865-bd64-c894af394891 service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-df219571-b9ad-4594-96bc-e69c0ddb6633 req-1e08dad5-78b5-4865-bd64-c894af394891 service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-df219571-b9ad-4594-96bc-e69c0ddb6633 req-1e08dad5-78b5-4865-bd64-c894af394891 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] No waiting events found dispatching network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:32:21 user nova-compute[73520]: WARNING nova.compute.manager [req-df219571-b9ad-4594-96bc-e69c0ddb6633 req-1e08dad5-78b5-4865-bd64-c894af394891 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received unexpected event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 for instance with vm_state active and task_state rescuing.
Aug 16 12:32:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Removed pending event for 25b02048-2937-440a-9809-eceeb3558856 due to event {{(pid=73520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 12:32:22 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189142.310155, 25b02048-2937-440a-9809-eceeb3558856 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:32:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] VM Resumed (Lifecycle Event)
Aug 16 12:32:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-627bedd4-04e0-4bde-936d-a263bc0d3d9a tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:32:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:32:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:32:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 12:32:22 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189142.3173974, 25b02048-2937-440a-9809-eceeb3558856 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:32:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] VM Started (Lifecycle Event)
Aug 16 12:32:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:32:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:32:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:34 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a209585-5dd0-4b3b-b171-638424fc2d48 req-9af48e3a-b34c-4f2f-8544-6f42dc1e9567 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Received event network-changed-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:32:34 user nova-compute[73520]: DEBUG nova.compute.manager [req-5a209585-5dd0-4b3b-b171-638424fc2d48 req-9af48e3a-b34c-4f2f-8544-6f42dc1e9567 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Refreshing instance network info cache due to event network-changed-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:32:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a209585-5dd0-4b3b-b171-638424fc2d48 req-9af48e3a-b34c-4f2f-8544-6f42dc1e9567 service nova] Acquiring lock "refresh_cache-1a8276cb-495e-4e55-aa8b-02b18118b51e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:32:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a209585-5dd0-4b3b-b171-638424fc2d48 req-9af48e3a-b34c-4f2f-8544-6f42dc1e9567 service nova] Acquired lock "refresh_cache-1a8276cb-495e-4e55-aa8b-02b18118b51e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:32:34 user nova-compute[73520]: DEBUG nova.network.neutron [req-5a209585-5dd0-4b3b-b171-638424fc2d48 req-9af48e3a-b34c-4f2f-8544-6f42dc1e9567 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Refreshing network info cache for port 70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:32:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:34 user nova-compute[73520]: DEBUG nova.objects.instance [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lazy-loading 'flavor' on Instance uuid 1a8276cb-495e-4e55-aa8b-02b18118b51e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Ignoring supplied device name: /dev/vdb
Aug 16 12:32:34 user nova-compute[73520]: DEBUG nova.network.neutron [req-5a209585-5dd0-4b3b-b171-638424fc2d48 req-9af48e3a-b34c-4f2f-8544-6f42dc1e9567 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Updated VIF entry in instance network info cache for port 70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:32:34 user nova-compute[73520]: DEBUG nova.network.neutron [req-5a209585-5dd0-4b3b-b171-638424fc2d48 req-9af48e3a-b34c-4f2f-8544-6f42dc1e9567 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Updating instance_info_cache with network_info: [{"id": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "address": "fa:16:3e:32:b9:30", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70bf9e8e-1f", "ovs_interfaceid": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:32:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5a209585-5dd0-4b3b-b171-638424fc2d48 req-9af48e3a-b34c-4f2f-8544-6f42dc1e9567 service nova] Releasing lock "refresh_cache-1a8276cb-495e-4e55-aa8b-02b18118b51e" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:35 user nova-compute[73520]: INFO nova.compute.manager [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Attaching volume 47fcd374-3516-44a8-ae58-ff2a69e47baa to /dev/vdb
Aug 16 12:32:35 user nova-compute[73520]: DEBUG os_brick.utils [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[36899226-8296-41ca-b58f-b9318f21c3c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee869c0-87ca-4682-aa81-9c3be7ffbbdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cf4108-8faa-482b-908d-7a567b16d5e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[73199e73-1ba8-4cdd-ad8b-3be6f6fac858]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:32:35 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:32:35 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[706a8dcc-5f3c-469b-99d9-fc2fb57312a7]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG os_brick.utils [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Updating existing volume attachment record: b0d19be5-2009-44c1-afb9-6921764a188c {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:32:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:40 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:32:40 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:32:41 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:32:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:32:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:32:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:32:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:32:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:47 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:32:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.007s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:48 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:32:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:32:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGjnUTKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:32:49 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:32:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:32:49 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:32:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:32:49 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[72663cd5-c871-4203-bec4-75ba200549df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:32:49 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f377c9-6a6d-43d4-b4c1-88651786477b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa] added
Aug 16 12:32:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f579e18d-78b9-4cd0-9106-33cb3162a44c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2c491e-6619-4d6b-bcf8-86b1d88a03f4]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGjnUTKy {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGjnUTKy" returned: 0 in 0.033s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdbb292-2310-432b-8002-2a19bb0a82f1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oGjnUTKy'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e63ba5-e145-48a0-93d4-a0df3d7d36b8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a15eb6-9749-432e-b9b9-fc71ebfdfaa3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:49 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:49 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:49 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:49 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:32:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:49 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:49 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:49 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:49 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:32:49 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cebc60b-820f-44af-8095-0a83ee53070e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa, portal: 172.16.0.220,3260]
Aug 16 12:32:50 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa, portal: 172.16.0.220,3260] successful.
Aug 16 12:32:50 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb024ce1-ed8f-4b9c-b63e-d295eb436ac6]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fe6de9-97c0-4527-a612-93688a1b77ef]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:50 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:50 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:50 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:50 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:32:50 user nova-compute[73520]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa (non-flash)
Aug 16 12:32:50 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:32:50 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:32:50 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:32:50 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:32:50 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:32:50 user nova-compute[73520]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa (non-flash)
Aug 16 12:32:50 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] HCTL ('38', '-', '-', 0) found on session 46 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[99599323-a2b1-437d-9bc1-8e26ac6dc998]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Searching for a device in session 46 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGjnUTKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-81bcbdbb-97df-4b4a-a378-8e61ac21ae43 req-1e7f136b-4dae-44f8-93fa-68b10231a322 service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Received event network-changed-dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-81bcbdbb-97df-4b4a-a378-8e61ac21ae43 req-1e7f136b-4dae-44f8-93fa-68b10231a322 service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Refreshing instance network info cache due to event network-changed-dc85c0d3-f29f-4255-84ed-38c36ebdb094. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-81bcbdbb-97df-4b4a-a378-8e61ac21ae43 req-1e7f136b-4dae-44f8-93fa-68b10231a322 service nova] Acquiring lock "refresh_cache-ce0355be-8b0e-4c8c-b052-10ac730fa6cf" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-81bcbdbb-97df-4b4a-a378-8e61ac21ae43 req-1e7f136b-4dae-44f8-93fa-68b10231a322 service nova] Acquired lock "refresh_cache-ce0355be-8b0e-4c8c-b052-10ac730fa6cf" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG nova.network.neutron [req-81bcbdbb-97df-4b4a-a378-8e61ac21ae43 req-1e7f136b-4dae-44f8-93fa-68b10231a322 service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Refreshing network info cache for port dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '23663383162623839', 'path': '/dev/sdg'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663383162623839', 'path': '/dev/sdg'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG nova.objects.instance [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lazy-loading 'flavor' on Instance uuid 1a8276cb-495e-4e55-aa8b-02b18118b51e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:32:51 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:32:51 user nova-compute[73520]:   <source dev="/dev/sdg"/>
Aug 16 12:32:51 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:32:51 user nova-compute[73520]:   <serial>47fcd374-3516-44a8-ae58-ff2a69e47baa</serial>
Aug 16 12:32:51 user nova-compute[73520]: </disk>
Aug 16 12:32:51 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] No VIF found with MAC fa:16:3e:32:b9:30, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e642d80c-f3a6-41ec-bf00-4b1eb8726fe0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.817s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:32:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:32:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:32:52 user nova-compute[73520]: DEBUG nova.network.neutron [req-81bcbdbb-97df-4b4a-a378-8e61ac21ae43 req-1e7f136b-4dae-44f8-93fa-68b10231a322 service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Updated VIF entry in instance network info cache for port dc85c0d3-f29f-4255-84ed-38c36ebdb094. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:32:52 user nova-compute[73520]: DEBUG nova.network.neutron [req-81bcbdbb-97df-4b4a-a378-8e61ac21ae43 req-1e7f136b-4dae-44f8-93fa-68b10231a322 service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Updating instance_info_cache with network_info: [{"id": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "address": "fa:16:3e:c1:d5:79", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc85c0d3-f2", "ovs_interfaceid": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-81bcbdbb-97df-4b4a-a378-8e61ac21ae43 req-1e7f136b-4dae-44f8-93fa-68b10231a322 service nova] Releasing lock "refresh_cache-ce0355be-8b0e-4c8c-b052-10ac730fa6cf" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:32:53 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:32:53 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7286MB free_disk=25.045360565185547GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d712e605-8ee2-4bd5-adce-61d0f284c835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 27659935-6eb3-4cea-9648-f5820cddda98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 25b02048-2937-440a-9809-eceeb3558856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 52275f84-b38b-4351-befe-9052b1e02612 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1a8276cb-495e-4e55-aa8b-02b18118b51e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ce0355be-8b0e-4c8c-b052-10ac730fa6cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:32:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:32:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:32:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:32:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:32:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:32:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:32:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:32:55 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:32:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:55 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Updating instance_info_cache with network_info: [{"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:32:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:32:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:32:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:32:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:33:02 user nova-compute[73520]: INFO nova.compute.claims [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Claim successful on node user
Aug 16 12:33:02 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG nova.network.neutron [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:33:02 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:33:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG nova.policy [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df9ef4b48f36408eba035f0d7e277dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446e9796da1f4303bb7d628fa8c8c3c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:33:02 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Creating image(s)
Aug 16 12:33:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "/opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "/opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "/opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk 1073741824" returned: 0 in 0.051s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG nova.network.neutron [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Successfully created port: 6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Cannot resize image /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG nova.objects.instance [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'migration_context' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Ensure instance console log exists: /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG nova.network.neutron [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Successfully updated port: 6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquired lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG nova.network.neutron [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-b5fdea84-7ce3-4f2a-831a-2ce3f8392932 req-a88ac05c-8ab2-47e3-8dc2-5ac753372a7d service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-changed-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-b5fdea84-7ce3-4f2a-831a-2ce3f8392932 req-a88ac05c-8ab2-47e3-8dc2-5ac753372a7d service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Refreshing instance network info cache due to event network-changed-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b5fdea84-7ce3-4f2a-831a-2ce3f8392932 req-a88ac05c-8ab2-47e3-8dc2-5ac753372a7d service nova] Acquiring lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG nova.network.neutron [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:04 user nova-compute[73520]: INFO nova.compute.manager [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Terminating instance
Aug 16 12:33:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG nova.network.neutron [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updating instance_info_cache with network_info: [{"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Releasing lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Instance network_info: |[{"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b5fdea84-7ce3-4f2a-831a-2ce3f8392932 req-a88ac05c-8ab2-47e3-8dc2-5ac753372a7d service nova] Acquired lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG nova.network.neutron [req-b5fdea84-7ce3-4f2a-831a-2ce3f8392932 req-a88ac05c-8ab2-47e3-8dc2-5ac753372a7d service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Refreshing network info cache for port 6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Start _get_guest_xml network_info=[{"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:33:04 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:33:04 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:33:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:33:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1747553426',display_name='tempest-AttachVolumeTestJSON-server-1747553426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1747553426',id=42,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF2K5lPCqq45wlqWBJxOjnJMaqjiorbGycI/+zIIrQyDX2lqhtiNH0sOEH1miqoWIiFDFfI+JbhEvZIwSQ6ThAdNXntyvNLGxVlW0nvg7ZrlFK5UVMdROmd3/SoB5yrFw==',key_name='tempest-keypair-1911074579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446e9796da1f4303bb7d628fa8c8c3c3',ramdisk_id='',reservation_id='r-0o6wl00i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1174912644',owner_user_name='tempest-AttachVolumeTestJSON-1174912644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:33:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9ef4b48f36408eba035f0d7e277dcb',uuid=26b0286b-9021-4859-88ac-760e7249a3d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converting VIF {"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.objects.instance [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'pci_devices' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-2fe806e7-acab-47bd-9d04-f8fd62697745 req-5a8bf0a3-7ec3-49de-b792-efe3680ff467 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Received event network-vif-unplugged-721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2fe806e7-acab-47bd-9d04-f8fd62697745 req-5a8bf0a3-7ec3-49de-b792-efe3680ff467 service nova] Acquiring lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2fe806e7-acab-47bd-9d04-f8fd62697745 req-5a8bf0a3-7ec3-49de-b792-efe3680ff467 service nova] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2fe806e7-acab-47bd-9d04-f8fd62697745 req-5a8bf0a3-7ec3-49de-b792-efe3680ff467 service nova] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-2fe806e7-acab-47bd-9d04-f8fd62697745 req-5a8bf0a3-7ec3-49de-b792-efe3680ff467 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] No waiting events found dispatching network-vif-unplugged-721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-2fe806e7-acab-47bd-9d04-f8fd62697745 req-5a8bf0a3-7ec3-49de-b792-efe3680ff467 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Received event network-vif-unplugged-721a7b26-4adf-4711-b0df-6842b589bb78 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:33:05 user nova-compute[73520]:   <uuid>26b0286b-9021-4859-88ac-760e7249a3d2</uuid>
Aug 16 12:33:05 user nova-compute[73520]:   <name>instance-0000002a</name>
Aug 16 12:33:05 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:33:05 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:33:05 user nova-compute[73520]:   <metadata>
Aug 16 12:33:05 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:33:05 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:33:05 user nova-compute[73520]:       <nova:name>tempest-AttachVolumeTestJSON-server-1747553426</nova:name>
Aug 16 12:33:05 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:33:04</nova:creationTime>
Aug 16 12:33:05 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:33:05 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:33:05 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:33:05 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:33:05 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:33:05 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:33:05 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:33:05 user nova-compute[73520]:       <nova:owner>
Aug 16 12:33:05 user nova-compute[73520]:         <nova:user uuid="df9ef4b48f36408eba035f0d7e277dcb">tempest-AttachVolumeTestJSON-1174912644-project-member</nova:user>
Aug 16 12:33:05 user nova-compute[73520]:         <nova:project uuid="446e9796da1f4303bb7d628fa8c8c3c3">tempest-AttachVolumeTestJSON-1174912644</nova:project>
Aug 16 12:33:05 user nova-compute[73520]:       </nova:owner>
Aug 16 12:33:05 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:33:05 user nova-compute[73520]:       <nova:ports>
Aug 16 12:33:05 user nova-compute[73520]:         <nova:port uuid="6e7cef18-ea49-45cb-a7e8-3e5292b6f48f">
Aug 16 12:33:05 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 12:33:05 user nova-compute[73520]:         </nova:port>
Aug 16 12:33:05 user nova-compute[73520]:       </nova:ports>
Aug 16 12:33:05 user nova-compute[73520]:     </nova:instance>
Aug 16 12:33:05 user nova-compute[73520]:   </metadata>
Aug 16 12:33:05 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:33:05 user nova-compute[73520]:     <system>
Aug 16 12:33:05 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:33:05 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:33:05 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:33:05 user nova-compute[73520]:       <entry name="serial">26b0286b-9021-4859-88ac-760e7249a3d2</entry>
Aug 16 12:33:05 user nova-compute[73520]:       <entry name="uuid">26b0286b-9021-4859-88ac-760e7249a3d2</entry>
Aug 16 12:33:05 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:33:05 user nova-compute[73520]:     </system>
Aug 16 12:33:05 user nova-compute[73520]:   </sysinfo>
Aug 16 12:33:05 user nova-compute[73520]:   <os>
Aug 16 12:33:05 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:33:05 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:33:05 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:33:05 user nova-compute[73520]:   </os>
Aug 16 12:33:05 user nova-compute[73520]:   <features>
Aug 16 12:33:05 user nova-compute[73520]:     <acpi/>
Aug 16 12:33:05 user nova-compute[73520]:     <apic/>
Aug 16 12:33:05 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:33:05 user nova-compute[73520]:   </features>
Aug 16 12:33:05 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:33:05 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:33:05 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:33:05 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:33:05 user nova-compute[73520]:   </clock>
Aug 16 12:33:05 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:33:05 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:33:05 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:33:05 user nova-compute[73520]:   </cpu>
Aug 16 12:33:05 user nova-compute[73520]:   <devices>
Aug 16 12:33:05 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:33:05 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:33:05 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk"/>
Aug 16 12:33:05 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:33:05 user nova-compute[73520]:     </disk>
Aug 16 12:33:05 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:33:05 user nova-compute[73520]:       <mac address="fa:16:3e:25:5f:15"/>
Aug 16 12:33:05 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:33:05 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:33:05 user nova-compute[73520]:       <target dev="tap6e7cef18-ea"/>
Aug 16 12:33:05 user nova-compute[73520]:     </interface>
Aug 16 12:33:05 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:33:05 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/console.log" append="off"/>
Aug 16 12:33:05 user nova-compute[73520]:     </serial>
Aug 16 12:33:05 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:33:05 user nova-compute[73520]:     <video>
Aug 16 12:33:05 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:33:05 user nova-compute[73520]:     </video>
Aug 16 12:33:05 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:33:05 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:33:05 user nova-compute[73520]:     </rng>
Aug 16 12:33:05 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:33:05 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:33:05 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:33:05 user nova-compute[73520]:     </memballoon>
Aug 16 12:33:05 user nova-compute[73520]:   </devices>
Aug 16 12:33:05 user nova-compute[73520]: </domain>
Aug 16 12:33:05 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1747553426',display_name='tempest-AttachVolumeTestJSON-server-1747553426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1747553426',id=42,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF2K5lPCqq45wlqWBJxOjnJMaqjiorbGycI/+zIIrQyDX2lqhtiNH0sOEH1miqoWIiFDFfI+JbhEvZIwSQ6ThAdNXntyvNLGxVlW0nvg7ZrlFK5UVMdROmd3/SoB5yrFw==',key_name='tempest-keypair-1911074579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446e9796da1f4303bb7d628fa8c8c3c3',ramdisk_id='',reservation_id='r-0o6wl00i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1174912644',owner_user_name='tempest-AttachVolumeTestJSON-1174912644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:33:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9ef4b48f36408eba035f0d7e277dcb',uuid=26b0286b-9021-4859-88ac-760e7249a3d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converting VIF {"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG os_vif [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e7cef18-ea, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e7cef18-ea, col_values=(('external_ids', {'iface-id': '6e7cef18-ea49-45cb-a7e8-3e5292b6f48f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:5f:15', 'vm-uuid': '26b0286b-9021-4859-88ac-760e7249a3d2'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:05 user nova-compute[73520]: INFO os_vif [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea')
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No VIF found with MAC fa:16:3e:25:5f:15, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.network.neutron [req-b5fdea84-7ce3-4f2a-831a-2ce3f8392932 req-a88ac05c-8ab2-47e3-8dc2-5ac753372a7d service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updated VIF entry in instance network info cache for port 6e7cef18-ea49-45cb-a7e8-3e5292b6f48f. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.network.neutron [req-b5fdea84-7ce3-4f2a-831a-2ce3f8392932 req-a88ac05c-8ab2-47e3-8dc2-5ac753372a7d service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updating instance_info_cache with network_info: [{"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b5fdea84-7ce3-4f2a-831a-2ce3f8392932 req-a88ac05c-8ab2-47e3-8dc2-5ac753372a7d service nova] Releasing lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Instance destroyed successfully.
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.objects.instance [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lazy-loading 'resources' on Instance uuid 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-508152035',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-508152035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5081520',id=37,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn+B6cTnP5iDXaNiPa8DlHcI2VCNPyY0ey1Jf1K0+XhtawbZUs6Ts7gmt2MT80eES7eBFWjyh+SaPTlfII4L1ZS3d6kmTpg6jswGY0sKlN28FP1fEuSQuilz5BnMjPW4Q==',key_name='tempest-keypair-1533305561',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:29:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d16aba93c82b40f08bc0558754584c03',ramdisk_id='',reservation_id='r-mtn4yeeg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1003690533',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:30:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='161e37aeeab540b888557cad6504b9e6',uuid=31c878ee-ff2c-42ff-aa73-453e7d47c6f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "721a7b26-4adf-4711-b0df-6842b589bb78", "address": "fa:16:3e:e3:da:c9", "network": {"id": "e257644d-4e85-47bb-99ad-249afdcbfa5b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-376827404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d16aba93c82b40f08bc0558754584c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721a7b26-4a", "ovs_interfaceid": "721a7b26-4adf-4711-b0df-6842b589bb78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Converting VIF {"id": "721a7b26-4adf-4711-b0df-6842b589bb78", "address": "fa:16:3e:e3:da:c9", "network": {"id": "e257644d-4e85-47bb-99ad-249afdcbfa5b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-376827404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d16aba93c82b40f08bc0558754584c03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721a7b26-4a", "ovs_interfaceid": "721a7b26-4adf-4711-b0df-6842b589bb78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:da:c9,bridge_name='br-int',has_traffic_filtering=True,id=721a7b26-4adf-4711-b0df-6842b589bb78,network=Network(e257644d-4e85-47bb-99ad-249afdcbfa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721a7b26-4a') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG os_vif [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:da:c9,bridge_name='br-int',has_traffic_filtering=True,id=721a7b26-4adf-4711-b0df-6842b589bb78,network=Network(e257644d-4e85-47bb-99ad-249afdcbfa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721a7b26-4a') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap721a7b26-4a, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:33:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:05 user nova-compute[73520]: INFO os_vif [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:da:c9,bridge_name='br-int',has_traffic_filtering=True,id=721a7b26-4adf-4711-b0df-6842b589bb78,network=Network(e257644d-4e85-47bb-99ad-249afdcbfa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721a7b26-4a')
Aug 16 12:33:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Deleting instance files /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9_del
Aug 16 12:33:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Deletion of /opt/stack/data/nova/instances/31c878ee-ff2c-42ff-aa73-453e7d47c6f9_del complete
Aug 16 12:33:06 user nova-compute[73520]: INFO nova.compute.manager [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Took 1.36 seconds to destroy the instance on the hypervisor.
Aug 16 12:33:06 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:33:06 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:33:06 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:33:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-6d69f5c8-040b-45f9-aecc-5340c8d6fbd2 req-859862eb-feca-4eef-8700-bd1d6f46aa7e service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6d69f5c8-040b-45f9-aecc-5340c8d6fbd2 req-859862eb-feca-4eef-8700-bd1d6f46aa7e service nova] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6d69f5c8-040b-45f9-aecc-5340c8d6fbd2 req-859862eb-feca-4eef-8700-bd1d6f46aa7e service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6d69f5c8-040b-45f9-aecc-5340c8d6fbd2 req-859862eb-feca-4eef-8700-bd1d6f46aa7e service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-6d69f5c8-040b-45f9-aecc-5340c8d6fbd2 req-859862eb-feca-4eef-8700-bd1d6f46aa7e service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] No waiting events found dispatching network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:33:07 user nova-compute[73520]: WARNING nova.compute.manager [req-6d69f5c8-040b-45f9-aecc-5340c8d6fbd2 req-859862eb-feca-4eef-8700-bd1d6f46aa7e service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received unexpected event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f for instance with vm_state building and task_state spawning.
Aug 16 12:33:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-0de9fbbe-8e97-4c2c-940d-e6e477487462 req-1e02dd10-9559-424f-a408-2abe88dd224b service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Received event network-vif-plugged-721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0de9fbbe-8e97-4c2c-940d-e6e477487462 req-1e02dd10-9559-424f-a408-2abe88dd224b service nova] Acquiring lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0de9fbbe-8e97-4c2c-940d-e6e477487462 req-1e02dd10-9559-424f-a408-2abe88dd224b service nova] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0de9fbbe-8e97-4c2c-940d-e6e477487462 req-1e02dd10-9559-424f-a408-2abe88dd224b service nova] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-0de9fbbe-8e97-4c2c-940d-e6e477487462 req-1e02dd10-9559-424f-a408-2abe88dd224b service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] No waiting events found dispatching network-vif-plugged-721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:33:07 user nova-compute[73520]: WARNING nova.compute.manager [req-0de9fbbe-8e97-4c2c-940d-e6e477487462 req-1e02dd10-9559-424f-a408-2abe88dd224b service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Received unexpected event network-vif-plugged-721a7b26-4adf-4711-b0df-6842b589bb78 for instance with vm_state active and task_state deleting.
Aug 16 12:33:07 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:33:07 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Took 1.12 seconds to deallocate network for instance.
Aug 16 12:33:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-e682b4f0-7149-46e9-877d-8d0ff9f9e274 req-90d563ec-b8c9-42ff-a4d0-cfa705534609 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Received event network-vif-deleted-721a7b26-4adf-4711-b0df-6842b589bb78 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:07 user nova-compute[73520]: INFO nova.compute.manager [req-e682b4f0-7149-46e9-877d-8d0ff9f9e274 req-90d563ec-b8c9-42ff-a4d0-cfa705534609 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Neutron deleted interface 721a7b26-4adf-4711-b0df-6842b589bb78; detaching it from the instance and deleting it from the info cache
Aug 16 12:33:07 user nova-compute[73520]: DEBUG nova.network.neutron [req-e682b4f0-7149-46e9-877d-8d0ff9f9e274 req-90d563ec-b8c9-42ff-a4d0-cfa705534609 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-e682b4f0-7149-46e9-877d-8d0ff9f9e274 req-90d563ec-b8c9-42ff-a4d0-cfa705534609 service nova] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Detach interface failed, port_id=721a7b26-4adf-4711-b0df-6842b589bb78, reason: Instance 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:33:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:07 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Deleted allocations for instance 31c878ee-ff2c-42ff-aa73-453e7d47c6f9
Aug 16 12:33:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-199bb4e6-a5f8-4c77-b284-2686ed2c5ddf tempest-TestServerVolumeAttachScenarioOldVersion-1003690533 tempest-TestServerVolumeAttachScenarioOldVersion-1003690533-project-member] Lock "31c878ee-ff2c-42ff-aa73-453e7d47c6f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.170s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189189.0250967, 26b0286b-9021-4859-88ac-760e7249a3d2 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:33:09 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] VM Resumed (Lifecycle Event)
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:33:09 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Instance spawned successfully.
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:33:09 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189189.0275877, 26b0286b-9021-4859-88ac-760e7249a3d2 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:33:09 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] VM Started (Lifecycle Event)
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-7678cdfe-eddc-4301-8cfd-1f0db88d55e8 req-f5409ce1-0373-4b67-a5e9-458bcf03cb45 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7678cdfe-eddc-4301-8cfd-1f0db88d55e8 req-f5409ce1-0373-4b67-a5e9-458bcf03cb45 service nova] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7678cdfe-eddc-4301-8cfd-1f0db88d55e8 req-f5409ce1-0373-4b67-a5e9-458bcf03cb45 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7678cdfe-eddc-4301-8cfd-1f0db88d55e8 req-f5409ce1-0373-4b67-a5e9-458bcf03cb45 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-7678cdfe-eddc-4301-8cfd-1f0db88d55e8 req-f5409ce1-0373-4b67-a5e9-458bcf03cb45 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] No waiting events found dispatching network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:33:09 user nova-compute[73520]: WARNING nova.compute.manager [req-7678cdfe-eddc-4301-8cfd-1f0db88d55e8 req-f5409ce1-0373-4b67-a5e9-458bcf03cb45 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received unexpected event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f for instance with vm_state building and task_state spawning.
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:33:09 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:33:09 user nova-compute[73520]: INFO nova.compute.manager [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Took 6.22 seconds to spawn the instance on the hypervisor.
Aug 16 12:33:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:33:09 user nova-compute[73520]: INFO nova.compute.manager [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Took 7.03 seconds to build instance.
Aug 16 12:33:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-370b8a71-8240-407e-be43-42b28d5c14b8 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.138s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:33:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:17 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:33:17 user nova-compute[73520]: INFO nova.compute.claims [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Claim successful on node user
Aug 16 12:33:18 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:33:18 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:33:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:33:18 user nova-compute[73520]: INFO nova.virt.block_device [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Booting with volume fde75cea-4dea-45af-aa11-ef2d3f4c9134 at /dev/vda
Aug 16 12:33:18 user nova-compute[73520]: DEBUG nova.policy [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17ed1823b0de433ab523470e235fdd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a693cd27934644be8e64731417c66783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG os_brick.utils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdac951-b36d-4dd6-b5f8-627ebdb617ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4736999-8ffd-4e6a-bbec-7aec748dfbd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[759b6e7c-ba9c-42c2-8b15-f0ef4444c4a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3cf0fb-8e05-4489-a466-385859b4cc83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:33:18 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:33:18 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac299efd-5490-4a17-bd1b-5f16ea8b22ee]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG os_brick.utils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:33:18 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Updating existing volume attachment record: 9b56b361-a96f-4041-a646-30c2ff2dad29 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:33:19 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Successfully created port: 98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Successfully updated port: 98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "refresh_cache-1bc7c0ce-c03c-4941-bdde-2506e7c51559" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquired lock "refresh_cache-1bc7c0ce-c03c-4941-bdde-2506e7c51559" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-08e8d19f-4b5d-4132-b5a4-99c1aacf1725 req-b68f328d-c380-4153-98a5-d61ff0260d82 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Received event network-changed-98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-08e8d19f-4b5d-4132-b5a4-99c1aacf1725 req-b68f328d-c380-4153-98a5-d61ff0260d82 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Refreshing instance network info cache due to event network-changed-98cd61dd-3051-41f3-bb39-c107faea4fc0. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-08e8d19f-4b5d-4132-b5a4-99c1aacf1725 req-b68f328d-c380-4153-98a5-d61ff0260d82 service nova] Acquiring lock "refresh_cache-1bc7c0ce-c03c-4941-bdde-2506e7c51559" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Updating instance_info_cache with network_info: [{"id": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "address": "fa:16:3e:f1:11:70", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd61dd-30", "ovs_interfaceid": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Releasing lock "refresh_cache-1bc7c0ce-c03c-4941-bdde-2506e7c51559" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Instance network_info: |[{"id": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "address": "fa:16:3e:f1:11:70", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd61dd-30", "ovs_interfaceid": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-08e8d19f-4b5d-4132-b5a4-99c1aacf1725 req-b68f328d-c380-4153-98a5-d61ff0260d82 service nova] Acquired lock "refresh_cache-1bc7c0ce-c03c-4941-bdde-2506e7c51559" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG nova.network.neutron [req-08e8d19f-4b5d-4132-b5a4-99c1aacf1725 req-b68f328d-c380-4153-98a5-d61ff0260d82 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Refreshing network info cache for port 98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189185.7845554, 31c878ee-ff2c-42ff-aa73-453e7d47c6f9 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:33:20 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] VM Stopped (Lifecycle Event)
Aug 16 12:33:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-da7660e6-61d8-4e3f-bf31-6f572997ad92 None None] [instance: 31c878ee-ff2c-42ff-aa73-453e7d47c6f9] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:33:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:33:21 user nova-compute[73520]: DEBUG nova.network.neutron [req-08e8d19f-4b5d-4132-b5a4-99c1aacf1725 req-b68f328d-c380-4153-98a5-d61ff0260d82 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Updated VIF entry in instance network info cache for port 98cd61dd-3051-41f3-bb39-c107faea4fc0. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:33:21 user nova-compute[73520]: DEBUG nova.network.neutron [req-08e8d19f-4b5d-4132-b5a4-99c1aacf1725 req-b68f328d-c380-4153-98a5-d61ff0260d82 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Updating instance_info_cache with network_info: [{"id": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "address": "fa:16:3e:f1:11:70", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd61dd-30", "ovs_interfaceid": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:33:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-08e8d19f-4b5d-4132-b5a4-99c1aacf1725 req-b68f328d-c380-4153-98a5-d61ff0260d82 service nova] Releasing lock "refresh_cache-1bc7c0ce-c03c-4941-bdde-2506e7c51559" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:33:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:33:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Creating image(s)
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Ensure instance console log exists: /opt/stack/data/nova/instances/1bc7c0ce-c03c-4941-bdde-2506e7c51559/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Start _get_guest_xml network_info=[{"id": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "address": "fa:16:3e:f1:11:70", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd61dd-30", "ovs_interfaceid": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdhTaJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1bc7c0ce-c03c-4941-bdde-2506e7c51559', 'attached_at': '', 'detached_at': '', 'volume_id': 'fde75cea-4dea-45af-aa11-ef2d3f4c9134', 'serial': 'fde75cea-4dea-45af-aa11-ef2d3f4c9134'}, 'attachment_id': '9b56b361-a96f-4041-a646-30c2ff2dad29', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:33:29 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:33:29 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:33:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdhTaJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:33:30 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:33:30 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:33:30 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e757abfa-74ea-40b4-84f5-9cdd45c7ac2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:33:30 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e26e747-6de4-4644-ae4d-42e0dc577b21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134] added
Aug 16 12:33:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19e6a87-bd25-4c14-bc38-e982adaab561]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4b90ad-c970-4878-a5fa-d574e7dd0dcf]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXdhTaJs {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXdhTaJs" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cd370c-8859-4f98-9de3-b270d6176316]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gXdhTaJs'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd48d415-db42-4f28-9a95-583b3993e1e4]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[67903af4-e459-4144-b1e2-02c25f984a36]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa (non-flash)
Aug 16 12:33:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa (non-flash)
Aug 16 12:33:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd61b34-cf1e-4693-abb4-bd689f4d8e88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134, portal: 172.16.0.220,3260]
Aug 16 12:33:30 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134, portal: 172.16.0.220,3260] successful.
Aug 16 12:33:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[071c9500-561c-43a8-9e88-da810b717368]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b86ba25-c23d-4786-95fb-f76e591340d0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa (non-flash)
Aug 16 12:33:30 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:33:30 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] HCTL ('39', '-', '-', 0) found on session 47 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8f173c-ef3c-4376-9869-ef3d05930ebd]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Searching for a device in session 47 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdhTaJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:33:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23639383839613830', 'path': '/dev/sdh'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639383839613830', 'path': '/dev/sdh'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:33:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2067372450',display_name='tempest-TestVolumeBootPattern-server-2067372450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2067372450',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJr/o6vrVZnxmYhfYixlxoifuhCtvsj5vKkg3ZAc0JSOeGoo3PmY57Yx5t3KGcWwXVP9aD5zqccktnbo7190qT8/kMlT5jQNhZVEjx4vkSe9H5//tD72sKPKPHQkEbRmQ==',key_name='tempest-TestVolumeBootPattern-586845281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-5sg9qal0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:33:18Z,user_data=None,user_id='17ed1823b0de433ab523470e235fdd72',uuid=1bc7c0ce-c03c-4941-bdde-2506e7c51559,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "address": "fa:16:3e:f1:11:70", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd61dd-30", "ovs_interfaceid": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "address": "fa:16:3e:f1:11:70", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd61dd-30", "ovs_interfaceid": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:11:70,bridge_name='br-int',has_traffic_filtering=True,id=98cd61dd-3051-41f3-bb39-c107faea4fc0,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd61dd-30') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bc7c0ce-c03c-4941-bdde-2506e7c51559 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:33:31 user nova-compute[73520]:   <uuid>1bc7c0ce-c03c-4941-bdde-2506e7c51559</uuid>
Aug 16 12:33:31 user nova-compute[73520]:   <name>instance-0000002b</name>
Aug 16 12:33:31 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:33:31 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:33:31 user nova-compute[73520]:   <metadata>
Aug 16 12:33:31 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:33:31 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:33:31 user nova-compute[73520]:       <nova:name>tempest-TestVolumeBootPattern-server-2067372450</nova:name>
Aug 16 12:33:31 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:33:29</nova:creationTime>
Aug 16 12:33:31 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:33:31 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:33:31 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:33:31 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:33:31 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:33:31 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:33:31 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:33:31 user nova-compute[73520]:       <nova:owner>
Aug 16 12:33:31 user nova-compute[73520]:         <nova:user uuid="17ed1823b0de433ab523470e235fdd72">tempest-TestVolumeBootPattern-496055159-project-member</nova:user>
Aug 16 12:33:31 user nova-compute[73520]:         <nova:project uuid="a693cd27934644be8e64731417c66783">tempest-TestVolumeBootPattern-496055159</nova:project>
Aug 16 12:33:31 user nova-compute[73520]:       </nova:owner>
Aug 16 12:33:31 user nova-compute[73520]:       <nova:ports>
Aug 16 12:33:31 user nova-compute[73520]:         <nova:port uuid="98cd61dd-3051-41f3-bb39-c107faea4fc0">
Aug 16 12:33:31 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 12:33:31 user nova-compute[73520]:         </nova:port>
Aug 16 12:33:31 user nova-compute[73520]:       </nova:ports>
Aug 16 12:33:31 user nova-compute[73520]:     </nova:instance>
Aug 16 12:33:31 user nova-compute[73520]:   </metadata>
Aug 16 12:33:31 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:33:31 user nova-compute[73520]:     <system>
Aug 16 12:33:31 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:33:31 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:33:31 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:33:31 user nova-compute[73520]:       <entry name="serial">1bc7c0ce-c03c-4941-bdde-2506e7c51559</entry>
Aug 16 12:33:31 user nova-compute[73520]:       <entry name="uuid">1bc7c0ce-c03c-4941-bdde-2506e7c51559</entry>
Aug 16 12:33:31 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:33:31 user nova-compute[73520]:     </system>
Aug 16 12:33:31 user nova-compute[73520]:   </sysinfo>
Aug 16 12:33:31 user nova-compute[73520]:   <os>
Aug 16 12:33:31 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:33:31 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:33:31 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:33:31 user nova-compute[73520]:   </os>
Aug 16 12:33:31 user nova-compute[73520]:   <features>
Aug 16 12:33:31 user nova-compute[73520]:     <acpi/>
Aug 16 12:33:31 user nova-compute[73520]:     <apic/>
Aug 16 12:33:31 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:33:31 user nova-compute[73520]:   </features>
Aug 16 12:33:31 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:33:31 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:33:31 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:33:31 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:33:31 user nova-compute[73520]:   </clock>
Aug 16 12:33:31 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:33:31 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:33:31 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:33:31 user nova-compute[73520]:   </cpu>
Aug 16 12:33:31 user nova-compute[73520]:   <devices>
Aug 16 12:33:31 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:33:31 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:33:31 user nova-compute[73520]:       <source dev="/dev/sdh"/>
Aug 16 12:33:31 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:33:31 user nova-compute[73520]:       <serial>fde75cea-4dea-45af-aa11-ef2d3f4c9134</serial>
Aug 16 12:33:31 user nova-compute[73520]:     </disk>
Aug 16 12:33:31 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:33:31 user nova-compute[73520]:       <mac address="fa:16:3e:f1:11:70"/>
Aug 16 12:33:31 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:33:31 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:33:31 user nova-compute[73520]:       <target dev="tap98cd61dd-30"/>
Aug 16 12:33:31 user nova-compute[73520]:     </interface>
Aug 16 12:33:31 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:33:31 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/1bc7c0ce-c03c-4941-bdde-2506e7c51559/console.log" append="off"/>
Aug 16 12:33:31 user nova-compute[73520]:     </serial>
Aug 16 12:33:31 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:33:31 user nova-compute[73520]:     <video>
Aug 16 12:33:31 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:33:31 user nova-compute[73520]:     </video>
Aug 16 12:33:31 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:33:31 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:33:31 user nova-compute[73520]:     </rng>
Aug 16 12:33:31 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:33:31 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:33:31 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:33:31 user nova-compute[73520]:     </memballoon>
Aug 16 12:33:31 user nova-compute[73520]:   </devices>
Aug 16 12:33:31 user nova-compute[73520]: </domain>
Aug 16 12:33:31 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:33:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2067372450',display_name='tempest-TestVolumeBootPattern-server-2067372450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2067372450',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJr/o6vrVZnxmYhfYixlxoifuhCtvsj5vKkg3ZAc0JSOeGoo3PmY57Yx5t3KGcWwXVP9aD5zqccktnbo7190qT8/kMlT5jQNhZVEjx4vkSe9H5//tD72sKPKPHQkEbRmQ==',key_name='tempest-TestVolumeBootPattern-586845281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-5sg9qal0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:33:18Z,user_data=None,user_id='17ed1823b0de433ab523470e235fdd72',uuid=1bc7c0ce-c03c-4941-bdde-2506e7c51559,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "address": "fa:16:3e:f1:11:70", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd61dd-30", "ovs_interfaceid": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "address": "fa:16:3e:f1:11:70", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd61dd-30", "ovs_interfaceid": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:11:70,bridge_name='br-int',has_traffic_filtering=True,id=98cd61dd-3051-41f3-bb39-c107faea4fc0,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd61dd-30') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG os_vif [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:11:70,bridge_name='br-int',has_traffic_filtering=True,id=98cd61dd-3051-41f3-bb39-c107faea4fc0,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd61dd-30') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98cd61dd-30, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98cd61dd-30, col_values=(('external_ids', {'iface-id': '98cd61dd-3051-41f3-bb39-c107faea4fc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:11:70', 'vm-uuid': '1bc7c0ce-c03c-4941-bdde-2506e7c51559'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:31 user nova-compute[73520]: INFO os_vif [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:11:70,bridge_name='br-int',has_traffic_filtering=True,id=98cd61dd-3051-41f3-bb39-c107faea4fc0,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd61dd-30')
Aug 16 12:33:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:33:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] No VIF found with MAC fa:16:3e:f1:11:70, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:33:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-a8fdd815-0a3e-439b-b136-2ce77a7e6405 req-756fd0c0-c803-4907-9719-6ec6daf5bece service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Received event network-vif-plugged-98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a8fdd815-0a3e-439b-b136-2ce77a7e6405 req-756fd0c0-c803-4907-9719-6ec6daf5bece service nova] Acquiring lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a8fdd815-0a3e-439b-b136-2ce77a7e6405 req-756fd0c0-c803-4907-9719-6ec6daf5bece service nova] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a8fdd815-0a3e-439b-b136-2ce77a7e6405 req-756fd0c0-c803-4907-9719-6ec6daf5bece service nova] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-a8fdd815-0a3e-439b-b136-2ce77a7e6405 req-756fd0c0-c803-4907-9719-6ec6daf5bece service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] No waiting events found dispatching network-vif-plugged-98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:33:33 user nova-compute[73520]: WARNING nova.compute.manager [req-a8fdd815-0a3e-439b-b136-2ce77a7e6405 req-756fd0c0-c803-4907-9719-6ec6daf5bece service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Received unexpected event network-vif-plugged-98cd61dd-3051-41f3-bb39-c107faea4fc0 for instance with vm_state building and task_state spawning.
Aug 16 12:33:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189214.8654099, 1bc7c0ce-c03c-4941-bdde-2506e7c51559 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:33:34 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] VM Resumed (Lifecycle Event)
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:33:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Instance spawned successfully.
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:33:34 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189214.866832, 1bc7c0ce-c03c-4941-bdde-2506e7c51559 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:33:34 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] VM Started (Lifecycle Event)
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:33:34 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:33:34 user nova-compute[73520]: INFO nova.compute.manager [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Took 5.07 seconds to spawn the instance on the hypervisor.
Aug 16 12:33:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:33:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Took 17.23 seconds to build instance.
Aug 16 12:33:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c8e5ca3e-877e-4125-bea9-b25734b3acda tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.330s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-303f343c-5259-4deb-89e4-df79b0919da7 req-dfb0041a-2fcf-44bd-b0e4-cb6e255cc714 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Received event network-vif-plugged-98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-303f343c-5259-4deb-89e4-df79b0919da7 req-dfb0041a-2fcf-44bd-b0e4-cb6e255cc714 service nova] Acquiring lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-303f343c-5259-4deb-89e4-df79b0919da7 req-dfb0041a-2fcf-44bd-b0e4-cb6e255cc714 service nova] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-303f343c-5259-4deb-89e4-df79b0919da7 req-dfb0041a-2fcf-44bd-b0e4-cb6e255cc714 service nova] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-303f343c-5259-4deb-89e4-df79b0919da7 req-dfb0041a-2fcf-44bd-b0e4-cb6e255cc714 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] No waiting events found dispatching network-vif-plugged-98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:33:35 user nova-compute[73520]: WARNING nova.compute.manager [req-303f343c-5259-4deb-89e4-df79b0919da7 req-dfb0041a-2fcf-44bd-b0e4-cb6e255cc714 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Received unexpected event network-vif-plugged-98cd61dd-3051-41f3-bb39-c107faea4fc0 for instance with vm_state active and task_state None.
Aug 16 12:33:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:40 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:33:40 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:33:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:33:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:33:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:33:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:43 user nova-compute[73520]: INFO nova.compute.manager [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Detaching volume 47fcd374-3516-44a8-ae58-ff2a69e47baa
Aug 16 12:33:43 user nova-compute[73520]: INFO nova.virt.block_device [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Attempting to driver detach volume 47fcd374-3516-44a8-ae58-ff2a69e47baa from mountpoint /dev/vdb
Aug 16 12:33:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Attempting to detach device vdb from instance 1a8276cb-495e-4e55-aa8b-02b18118b51e from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:33:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:33:43 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:33:43 user nova-compute[73520]:   <source dev="/dev/sdg"/>
Aug 16 12:33:43 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:33:43 user nova-compute[73520]:   <serial>47fcd374-3516-44a8-ae58-ff2a69e47baa</serial>
Aug 16 12:33:43 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:33:43 user nova-compute[73520]: </disk>
Aug 16 12:33:43 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:33:43 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Successfully detached device vdb from instance 1a8276cb-495e-4e55-aa8b-02b18118b51e from the persistent domain config.
Aug 16 12:33:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1a8276cb-495e-4e55-aa8b-02b18118b51e from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:33:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:33:43 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:33:43 user nova-compute[73520]:   <source dev="/dev/sdg"/>
Aug 16 12:33:43 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:33:43 user nova-compute[73520]:   <serial>47fcd374-3516-44a8-ae58-ff2a69e47baa</serial>
Aug 16 12:33:43 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:33:43 user nova-compute[73520]: </disk>
Aug 16 12:33:43 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692189224.1964145, 1a8276cb-495e-4e55-aa8b-02b18118b51e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1a8276cb-495e-4e55-aa8b-02b18118b51e {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:33:44 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Successfully detached device vdb from instance 1a8276cb-495e-4e55-aa8b-02b18118b51e from the live domain config.
Aug 16 12:33:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGjnUTKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:33:44 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18b0e09-f2e4-4188-96d4-7f1edca752f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2526e2-ba65-4d16-8d0e-1a1939ef47be]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:33:44 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:33:44 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:33:44 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:33:44 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:33:44 user nova-compute[73520]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa (non-flash)
Aug 16 12:33:44 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:33:44 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:33:44 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:33:44 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:33:44 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:33:44 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:33:44 user nova-compute[73520]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa (non-flash)
Aug 16 12:33:44 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:33:44 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c75be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa'): ({'sdg'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Removing single pathed devices sdg {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e45150-b772-46e4-a433-2bc909b3e83e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef71a88-0aed-41ad-a821-7611068a7256]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Flushing IO for device /dev/sdg {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ac35db-b734-47dc-9193-1e144caba358]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d438a8-9787-47dc-ad3a-b86524ed8a42]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] SCSI volumes sdg have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e611288f-c106-49bc-b06d-9ad6e8c1d388]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f693f795-c260-403f-944f-103385ec6f52]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa, portal: 172.16.0.220,3260]
Aug 16 12:33:44 user nova-compute[73520]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa, portal: 172.16.0.220,3260] successful.
Aug 16 12:33:44 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb4a943-429c-4043-bfac-5e61a269ac33]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] <== disconnect_volume: return (322ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:33:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:33:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:33:45 user nova-compute[73520]: DEBUG nova.objects.instance [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lazy-loading 'flavor' on Instance uuid 1a8276cb-495e-4e55-aa8b-02b18118b51e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:33:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0b119c75-6903-47c8-87a1-ed12275bf8c5 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.052s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.935s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:45 user nova-compute[73520]: INFO nova.compute.manager [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Terminating instance
Aug 16 12:33:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:33:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-121dbf0e-e51b-4f3e-99e7-c0bc79c26a57 req-760e157a-24bf-4016-8558-264e9fb9718c service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Received event network-vif-unplugged-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-121dbf0e-e51b-4f3e-99e7-c0bc79c26a57 req-760e157a-24bf-4016-8558-264e9fb9718c service nova] Acquiring lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-121dbf0e-e51b-4f3e-99e7-c0bc79c26a57 req-760e157a-24bf-4016-8558-264e9fb9718c service nova] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-121dbf0e-e51b-4f3e-99e7-c0bc79c26a57 req-760e157a-24bf-4016-8558-264e9fb9718c service nova] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-121dbf0e-e51b-4f3e-99e7-c0bc79c26a57 req-760e157a-24bf-4016-8558-264e9fb9718c service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] No waiting events found dispatching network-vif-unplugged-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-121dbf0e-e51b-4f3e-99e7-c0bc79c26a57 req-760e157a-24bf-4016-8558-264e9fb9718c service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Received event network-vif-unplugged-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:33:46 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Instance destroyed successfully.
Aug 16 12:33:46 user nova-compute[73520]: DEBUG nova.objects.instance [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lazy-loading 'resources' on Instance uuid 1a8276cb-495e-4e55-aa8b-02b18118b51e {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1289886783',display_name='tempest-VolumesSnapshotTestJSON-instance-1289886783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1289886783',id=40,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0QJvFv496IJWriUK3tBwQA23SPAB0VMCBSOCTujg+ASpQZpM58FbSp0KgFBStqK5CnwGLC/H0CCF6UWHqPIw46x2ApgJgP8Z7VFsLP1lFyUr1K99CtfMun9xAal4OQXg==',key_name='tempest-keypair-432646912',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:30:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1870ba83d8124a6c9624afde2cdd3752',ramdisk_id='',reservation_id='r-sy6v1i6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1304228647',owner_user_name='tempest-VolumesSnapshotTestJSON-1304228647-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:30:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d1fb48f56ed426b8cc984a7973ab208',uuid=1a8276cb-495e-4e55-aa8b-02b18118b51e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "address": "fa:16:3e:32:b9:30", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70bf9e8e-1f", "ovs_interfaceid": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Converting VIF {"id": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "address": "fa:16:3e:32:b9:30", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70bf9e8e-1f", "ovs_interfaceid": "70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:b9:30,bridge_name='br-int',has_traffic_filtering=True,id=70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70bf9e8e-1f') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG os_vif [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:b9:30,bridge_name='br-int',has_traffic_filtering=True,id=70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70bf9e8e-1f') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70bf9e8e-1f, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:46 user nova-compute[73520]: INFO os_vif [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:b9:30,bridge_name='br-int',has_traffic_filtering=True,id=70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70bf9e8e-1f')
Aug 16 12:33:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGjnUTKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:33:46 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:33:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47fcd374-3516-44a8-ae58-ff2a69e47baa', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30c71f0-26db-4a68-afa2-afcc8cd6e163]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf76915a-5b92-41b7-9ea1-53a839b7a4e0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:33:46 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:33:46 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:33:46 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:33:46 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:33:46 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:33:46 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:33:46 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:33:46 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:33:46 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:33:46 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:33:46 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:33:46 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c7ae170>, {}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Disconnecting from: [] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] <== disconnect_volume: return (63ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:33:46 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Deleting instance files /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e_del
Aug 16 12:33:46 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Deletion of /opt/stack/data/nova/instances/1a8276cb-495e-4e55-aa8b-02b18118b51e_del complete
Aug 16 12:33:46 user nova-compute[73520]: INFO nova.compute.manager [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 12:33:46 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:33:46 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:33:47 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:33:47 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Took 0.91 seconds to deallocate network for instance.
Aug 16 12:33:47 user nova-compute[73520]: WARNING nova.volume.cinder [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Attachment b0d19be5-2009-44c1-afb9-6921764a188c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b0d19be5-2009-44c1-afb9-6921764a188c. (HTTP 404) (Request-ID: req-4f0ec0da-9e36-4be8-95b6-3bbf7424ed2c)
Aug 16 12:33:47 user nova-compute[73520]: INFO nova.compute.manager [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Took 0.02 seconds to detach 1 volumes for instance.
Aug 16 12:33:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:47 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:33:47 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:33:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:47 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Deleted allocations for instance 1a8276cb-495e-4e55-aa8b-02b18118b51e
Aug 16 12:33:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6c37e1b1-e74d-4493-9623-bf52a72f70a0 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.408s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-33cc6d56-8c87-45d2-b3dd-ea7d09d5c97f req-a34e1172-f239-413f-a4c1-12628afb0a39 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Received event network-vif-plugged-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-33cc6d56-8c87-45d2-b3dd-ea7d09d5c97f req-a34e1172-f239-413f-a4c1-12628afb0a39 service nova] Acquiring lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-33cc6d56-8c87-45d2-b3dd-ea7d09d5c97f req-a34e1172-f239-413f-a4c1-12628afb0a39 service nova] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-33cc6d56-8c87-45d2-b3dd-ea7d09d5c97f req-a34e1172-f239-413f-a4c1-12628afb0a39 service nova] Lock "1a8276cb-495e-4e55-aa8b-02b18118b51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-33cc6d56-8c87-45d2-b3dd-ea7d09d5c97f req-a34e1172-f239-413f-a4c1-12628afb0a39 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] No waiting events found dispatching network-vif-plugged-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:33:48 user nova-compute[73520]: WARNING nova.compute.manager [req-33cc6d56-8c87-45d2-b3dd-ea7d09d5c97f req-a34e1172-f239-413f-a4c1-12628afb0a39 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Received unexpected event network-vif-plugged-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad for instance with vm_state deleted and task_state None.
Aug 16 12:33:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-33cc6d56-8c87-45d2-b3dd-ea7d09d5c97f req-a34e1172-f239-413f-a4c1-12628afb0a39 service nova] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Received event network-vif-deleted-70bf9e8e-1f37-4c5e-bae4-2deddbfa8dad {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:48 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:33:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:48 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:33:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:33:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:33:49 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:33:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:33:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:33:53 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:33:53 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7341MB free_disk=25.06796646118164GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d712e605-8ee2-4bd5-adce-61d0f284c835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 27659935-6eb3-4cea-9648-f5820cddda98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 25b02048-2937-440a-9809-eceeb3558856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 52275f84-b38b-4351-befe-9052b1e02612 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ce0355be-8b0e-4c8c-b052-10ac730fa6cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 26b0286b-9021-4859-88ac-760e7249a3d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1bc7c0ce-c03c-4941-bdde-2506e7c51559 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing inventories for resource provider 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating ProviderTree inventory for provider 70dde5f5-9594-47c3-954e-598dd3089747 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing aggregate associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, aggregates: None {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing trait associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.727s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:33:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:33:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:33:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:33:54 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:33:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:54 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Updating instance_info_cache with network_info: [{"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:33:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-6ed1c5ac-d727-4157-a294-55b49ed26eea" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:33:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:33:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:33:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 12:33:55 user nova-compute[73520]: INFO nova.compute.manager [None req-0a40ddac-85ca-4dd0-9957-bb68ddfc8db0 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Unrescuing
Aug 16 12:33:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0a40ddac-85ca-4dd0-9957-bb68ddfc8db0 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "refresh_cache-52275f84-b38b-4351-befe-9052b1e02612" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:33:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0a40ddac-85ca-4dd0-9957-bb68ddfc8db0 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquired lock "refresh_cache-52275f84-b38b-4351-befe-9052b1e02612" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:33:55 user nova-compute[73520]: DEBUG nova.network.neutron [None req-0a40ddac-85ca-4dd0-9957-bb68ddfc8db0 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:33:56 user nova-compute[73520]: DEBUG nova.network.neutron [None req-0a40ddac-85ca-4dd0-9957-bb68ddfc8db0 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Updating instance_info_cache with network_info: [{"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:33:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0a40ddac-85ca-4dd0-9957-bb68ddfc8db0 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Releasing lock "refresh_cache-52275f84-b38b-4351-befe-9052b1e02612" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:33:56 user nova-compute[73520]: DEBUG nova.objects.instance [None req-0a40ddac-85ca-4dd0-9957-bb68ddfc8db0 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'flavor' on Instance uuid 52275f84-b38b-4351-befe-9052b1e02612 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:33:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-20db1c8b-3d7d-4974-a835-630b87fa351a req-407aa392-df33-4d7a-ad41-6f34295810a2 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-unplugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20db1c8b-3d7d-4974-a835-630b87fa351a req-407aa392-df33-4d7a-ad41-6f34295810a2 service nova] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20db1c8b-3d7d-4974-a835-630b87fa351a req-407aa392-df33-4d7a-ad41-6f34295810a2 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-20db1c8b-3d7d-4974-a835-630b87fa351a req-407aa392-df33-4d7a-ad41-6f34295810a2 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-20db1c8b-3d7d-4974-a835-630b87fa351a req-407aa392-df33-4d7a-ad41-6f34295810a2 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] No waiting events found dispatching network-vif-unplugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:33:56 user nova-compute[73520]: WARNING nova.compute.manager [req-20db1c8b-3d7d-4974-a835-630b87fa351a req-407aa392-df33-4d7a-ad41-6f34295810a2 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received unexpected event network-vif-unplugged-614067cd-fd42-4bc4-8707-742fde3c1b05 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:33:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:57 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Instance destroyed successfully.
Aug 16 12:33:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-f674c935-eacc-4240-a907-ba72f731eb48 req-d69df878-c2f6-4235-8cda-67aa87725f13 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f674c935-eacc-4240-a907-ba72f731eb48 req-d69df878-c2f6-4235-8cda-67aa87725f13 service nova] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f674c935-eacc-4240-a907-ba72f731eb48 req-d69df878-c2f6-4235-8cda-67aa87725f13 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f674c935-eacc-4240-a907-ba72f731eb48 req-d69df878-c2f6-4235-8cda-67aa87725f13 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-f674c935-eacc-4240-a907-ba72f731eb48 req-d69df878-c2f6-4235-8cda-67aa87725f13 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] No waiting events found dispatching network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:33:58 user nova-compute[73520]: WARNING nova.compute.manager [req-f674c935-eacc-4240-a907-ba72f731eb48 req-d69df878-c2f6-4235-8cda-67aa87725f13 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received unexpected event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:33:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-f674c935-eacc-4240-a907-ba72f731eb48 req-d69df878-c2f6-4235-8cda-67aa87725f13 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f674c935-eacc-4240-a907-ba72f731eb48 req-d69df878-c2f6-4235-8cda-67aa87725f13 service nova] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f674c935-eacc-4240-a907-ba72f731eb48 req-d69df878-c2f6-4235-8cda-67aa87725f13 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f674c935-eacc-4240-a907-ba72f731eb48 req-d69df878-c2f6-4235-8cda-67aa87725f13 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:33:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-f674c935-eacc-4240-a907-ba72f731eb48 req-d69df878-c2f6-4235-8cda-67aa87725f13 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] No waiting events found dispatching network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:33:58 user nova-compute[73520]: WARNING nova.compute.manager [req-f674c935-eacc-4240-a907-ba72f731eb48 req-d69df878-c2f6-4235-8cda-67aa87725f13 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received unexpected event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:33:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:33:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:33:59 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:33:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 12:33:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] There are 0 instances to clean {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 12:34:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Removed pending event for 52275f84-b38b-4351-befe-9052b1e02612 due to event {{(pid=73520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 12:34:00 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189240.4635162, 52275f84-b38b-4351-befe-9052b1e02612 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:34:00 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] VM Resumed (Lifecycle Event)
Aug 16 12:34:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-0a40ddac-85ca-4dd0-9957-bb68ddfc8db0 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:34:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:34:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:34:00 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 12:34:00 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189240.4639404, 52275f84-b38b-4351-befe-9052b1e02612 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:34:00 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] VM Started (Lifecycle Event)
Aug 16 12:34:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:34:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:34:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-b86a33ba-cf8b-4bc4-aa4c-dfbe9b952eed req-cbb4b4e0-3fee-4afe-8f51-d12f609a70b0 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:34:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b86a33ba-cf8b-4bc4-aa4c-dfbe9b952eed req-cbb4b4e0-3fee-4afe-8f51-d12f609a70b0 service nova] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b86a33ba-cf8b-4bc4-aa4c-dfbe9b952eed req-cbb4b4e0-3fee-4afe-8f51-d12f609a70b0 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b86a33ba-cf8b-4bc4-aa4c-dfbe9b952eed req-cbb4b4e0-3fee-4afe-8f51-d12f609a70b0 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-b86a33ba-cf8b-4bc4-aa4c-dfbe9b952eed req-cbb4b4e0-3fee-4afe-8f51-d12f609a70b0 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] No waiting events found dispatching network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:34:00 user nova-compute[73520]: WARNING nova.compute.manager [req-b86a33ba-cf8b-4bc4-aa4c-dfbe9b952eed req-cbb4b4e0-3fee-4afe-8f51-d12f609a70b0 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received unexpected event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 for instance with vm_state active and task_state None.
Aug 16 12:34:01 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189226.365597, 1a8276cb-495e-4e55-aa8b-02b18118b51e => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:34:01 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] VM Stopped (Lifecycle Event)
Aug 16 12:34:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-01fab5b4-77ba-442a-a90b-00e813f39a58 None None] [instance: 1a8276cb-495e-4e55-aa8b-02b18118b51e] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:34:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:07 user nova-compute[73520]: INFO nova.compute.manager [None req-708cfad7-dd74-46de-a3b4-a413239c7f48 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Unrescuing
Aug 16 12:34:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-708cfad7-dd74-46de-a3b4-a413239c7f48 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:34:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-708cfad7-dd74-46de-a3b4-a413239c7f48 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquired lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:34:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-708cfad7-dd74-46de-a3b4-a413239c7f48 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:34:08 user nova-compute[73520]: DEBUG nova.network.neutron [None req-708cfad7-dd74-46de-a3b4-a413239c7f48 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Updating instance_info_cache with network_info: [{"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:34:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-708cfad7-dd74-46de-a3b4-a413239c7f48 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Releasing lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:34:08 user nova-compute[73520]: DEBUG nova.objects.instance [None req-708cfad7-dd74-46de-a3b4-a413239c7f48 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'flavor' on Instance uuid 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:34:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-b892f06f-24a5-43bd-ad48-34277a988992 req-6c21a51f-9cb5-47c8-83d5-7b842950a540 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-unplugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:34:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b892f06f-24a5-43bd-ad48-34277a988992 req-6c21a51f-9cb5-47c8-83d5-7b842950a540 service nova] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b892f06f-24a5-43bd-ad48-34277a988992 req-6c21a51f-9cb5-47c8-83d5-7b842950a540 service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b892f06f-24a5-43bd-ad48-34277a988992 req-6c21a51f-9cb5-47c8-83d5-7b842950a540 service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-b892f06f-24a5-43bd-ad48-34277a988992 req-6c21a51f-9cb5-47c8-83d5-7b842950a540 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] No waiting events found dispatching network-vif-unplugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:34:08 user nova-compute[73520]: WARNING nova.compute.manager [req-b892f06f-24a5-43bd-ad48-34277a988992 req-6c21a51f-9cb5-47c8-83d5-7b842950a540 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received unexpected event network-vif-unplugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:34:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:08 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 25b02048-2937-440a-9809-eceeb3558856] Instance destroyed successfully.
Aug 16 12:34:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-02ae7fdc-4052-406b-8ff5-c0446343fbfe req-232c2ba2-834d-4957-ac7e-95c18336a1eb service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:34:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-02ae7fdc-4052-406b-8ff5-c0446343fbfe req-232c2ba2-834d-4957-ac7e-95c18336a1eb service nova] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-02ae7fdc-4052-406b-8ff5-c0446343fbfe req-232c2ba2-834d-4957-ac7e-95c18336a1eb service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-02ae7fdc-4052-406b-8ff5-c0446343fbfe req-232c2ba2-834d-4957-ac7e-95c18336a1eb service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-02ae7fdc-4052-406b-8ff5-c0446343fbfe req-232c2ba2-834d-4957-ac7e-95c18336a1eb service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] No waiting events found dispatching network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:34:10 user nova-compute[73520]: WARNING nova.compute.manager [req-02ae7fdc-4052-406b-8ff5-c0446343fbfe req-232c2ba2-834d-4957-ac7e-95c18336a1eb service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received unexpected event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 for instance with vm_state rescued and task_state unrescuing.
Aug 16 12:34:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Removed pending event for 25b02048-2937-440a-9809-eceeb3558856 due to event {{(pid=73520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189252.2999706, 25b02048-2937-440a-9809-eceeb3558856 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:34:12 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] VM Resumed (Lifecycle Event)
Aug 16 12:34:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-708cfad7-dd74-46de-a3b4-a413239c7f48 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:34:12 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 12:34:12 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189252.3142626, 25b02048-2937-440a-9809-eceeb3558856 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:34:12 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] VM Started (Lifecycle Event)
Aug 16 12:34:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-b1d94549-7b7f-4a25-a658-34a308e0140c req-679a3fa7-6c9a-4d22-ad5d-ec0a3f57691b service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b1d94549-7b7f-4a25-a658-34a308e0140c req-679a3fa7-6c9a-4d22-ad5d-ec0a3f57691b service nova] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b1d94549-7b7f-4a25-a658-34a308e0140c req-679a3fa7-6c9a-4d22-ad5d-ec0a3f57691b service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b1d94549-7b7f-4a25-a658-34a308e0140c req-679a3fa7-6c9a-4d22-ad5d-ec0a3f57691b service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-b1d94549-7b7f-4a25-a658-34a308e0140c req-679a3fa7-6c9a-4d22-ad5d-ec0a3f57691b service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] No waiting events found dispatching network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:34:12 user nova-compute[73520]: WARNING nova.compute.manager [req-b1d94549-7b7f-4a25-a658-34a308e0140c req-679a3fa7-6c9a-4d22-ad5d-ec0a3f57691b service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received unexpected event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 for instance with vm_state active and task_state None.
Aug 16 12:34:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-b1d94549-7b7f-4a25-a658-34a308e0140c req-679a3fa7-6c9a-4d22-ad5d-ec0a3f57691b service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b1d94549-7b7f-4a25-a658-34a308e0140c req-679a3fa7-6c9a-4d22-ad5d-ec0a3f57691b service nova] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b1d94549-7b7f-4a25-a658-34a308e0140c req-679a3fa7-6c9a-4d22-ad5d-ec0a3f57691b service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b1d94549-7b7f-4a25-a658-34a308e0140c req-679a3fa7-6c9a-4d22-ad5d-ec0a3f57691b service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-b1d94549-7b7f-4a25-a658-34a308e0140c req-679a3fa7-6c9a-4d22-ad5d-ec0a3f57691b service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] No waiting events found dispatching network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:34:12 user nova-compute[73520]: WARNING nova.compute.manager [req-b1d94549-7b7f-4a25-a658-34a308e0140c req-679a3fa7-6c9a-4d22-ad5d-ec0a3f57691b service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received unexpected event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 for instance with vm_state active and task_state None.
Aug 16 12:34:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "27659935-6eb3-4cea-9648-f5820cddda98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:12 user nova-compute[73520]: INFO nova.compute.manager [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Terminating instance
Aug 16 12:34:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-45bdc8a1-c2f9-4ece-acbf-f4def435a2a2 req-121eb9eb-9598-4a58-bfd5-6afedcac272a service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-unplugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-45bdc8a1-c2f9-4ece-acbf-f4def435a2a2 req-121eb9eb-9598-4a58-bfd5-6afedcac272a service nova] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-45bdc8a1-c2f9-4ece-acbf-f4def435a2a2 req-121eb9eb-9598-4a58-bfd5-6afedcac272a service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-45bdc8a1-c2f9-4ece-acbf-f4def435a2a2 req-121eb9eb-9598-4a58-bfd5-6afedcac272a service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-45bdc8a1-c2f9-4ece-acbf-f4def435a2a2 req-121eb9eb-9598-4a58-bfd5-6afedcac272a service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] No waiting events found dispatching network-vif-unplugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-45bdc8a1-c2f9-4ece-acbf-f4def435a2a2 req-121eb9eb-9598-4a58-bfd5-6afedcac272a service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-unplugged-8018c557-722c-41a7-91e0-f63bc6568bac for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:34:13 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Instance destroyed successfully.
Aug 16 12:34:13 user nova-compute[73520]: DEBUG nova.objects.instance [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lazy-loading 'resources' on Instance uuid 27659935-6eb3-4cea-9648-f5820cddda98 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:25:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-576632488',display_name='tempest-ServerActionsTestOtherB-server-576632488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-576632488',id=34,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa+wt9FJevF0VcG5IW9UPpcwllZecsxipO+cOwPONy0JXrxwIIn5VueYzwt5Y4Fz26HPB5B2yhLRiuQ1H/JJF0RqBlDYiGwQFxVVbFuKbbBpDS5B0RYzbNj/n52YCPO2A==',key_name='tempest-keypair-872928149',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:31:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65805b8eab71460caf571e52648c40d4',ramdisk_id='',reservation_id='r-54clw1uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1849139886',owner_user_name='tempest-ServerActionsTestOtherB-1849139886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='354985a41cf846dab967f7d238e19319',uuid=27659935-6eb3-4cea-9648-f5820cddda98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converting VIF {"id": "8018c557-722c-41a7-91e0-f63bc6568bac", "address": "fa:16:3e:e5:78:5d", "network": {"id": "6020260b-1d23-46e2-b0c8-f67b89c33b5c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-631465464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65805b8eab71460caf571e52648c40d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8018c557-72", "ovs_interfaceid": "8018c557-722c-41a7-91e0-f63bc6568bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG os_vif [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8018c557-72, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:13 user nova-compute[73520]: INFO os_vif [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:78:5d,bridge_name='br-int',has_traffic_filtering=True,id=8018c557-722c-41a7-91e0-f63bc6568bac,network=Network(6020260b-1d23-46e2-b0c8-f67b89c33b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8018c557-72')
Aug 16 12:34:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSLAzyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:34:13 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:34:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3d5ac5-9533-49bc-92d9-23663eafea75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0ff4bb-68b9-4b72-9279-e5878daf4ae6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:34:13 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:34:13 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:34:13 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:34:13 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:34:13 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:34:13 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:34:13 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:34:13 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:34:13 user nova-compute[73520]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 (non-flash)
Aug 16 12:34:13 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:34:13 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:34:13 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c117490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7'): ({'sde'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Removing single pathed devices sde {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f646f15e-d8f4-4ff8-9818-4c6d64ccd2fa]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e69117-d956-47de-bccf-7b19553f7b0d]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Flushing IO for device /dev/sde {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e6d759-7755-4c16-a790-537966ae7171]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:13 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10e3009-5d7b-44c5-9988-b27ae8a585ee]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10f3a5d-6f22-4a68-9e27-7562f85dc1d3]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e83737-77b7-4e42-bc43-b5b06aacef08]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260]
Aug 16 12:34:14 user nova-compute[73520]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7, portal: 172.16.0.220,3260] successful.
Aug 16 12:34:14 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfc736d-08db-4664-b12e-9955e4fc00f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f258f8f-c1be-4e64-90c0-f286ca7d3808]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] <== disconnect_volume: return (385ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:34:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Deleting instance files /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98_del
Aug 16 12:34:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Deletion of /opt/stack/data/nova/instances/27659935-6eb3-4cea-9648-f5820cddda98_del complete
Aug 16 12:34:14 user nova-compute[73520]: INFO nova.compute.manager [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Took 1.47 seconds to destroy the instance on the hypervisor.
Aug 16 12:34:14 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:34:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-a47d810e-9637-415a-9284-1189028f904b req-795adff5-35cd-482b-aaca-3366ad650272 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:34:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a47d810e-9637-415a-9284-1189028f904b req-795adff5-35cd-482b-aaca-3366ad650272 service nova] Acquiring lock "27659935-6eb3-4cea-9648-f5820cddda98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a47d810e-9637-415a-9284-1189028f904b req-795adff5-35cd-482b-aaca-3366ad650272 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a47d810e-9637-415a-9284-1189028f904b req-795adff5-35cd-482b-aaca-3366ad650272 service nova] Lock "27659935-6eb3-4cea-9648-f5820cddda98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-a47d810e-9637-415a-9284-1189028f904b req-795adff5-35cd-482b-aaca-3366ad650272 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] No waiting events found dispatching network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:34:15 user nova-compute[73520]: WARNING nova.compute.manager [req-a47d810e-9637-415a-9284-1189028f904b req-795adff5-35cd-482b-aaca-3366ad650272 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received unexpected event network-vif-plugged-8018c557-722c-41a7-91e0-f63bc6568bac for instance with vm_state active and task_state deleting.
Aug 16 12:34:15 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:34:15 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Took 1.25 seconds to deallocate network for instance.
Aug 16 12:34:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-38c510ca-bbae-4b1b-9334-ea2005143b6a req-1b573524-a149-4386-b99a-6e79a6b558b6 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Received event network-vif-deleted-8018c557-722c-41a7-91e0-f63bc6568bac {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:34:15 user nova-compute[73520]: INFO nova.compute.manager [req-38c510ca-bbae-4b1b-9334-ea2005143b6a req-1b573524-a149-4386-b99a-6e79a6b558b6 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Neutron deleted interface 8018c557-722c-41a7-91e0-f63bc6568bac; detaching it from the instance and deleting it from the info cache
Aug 16 12:34:15 user nova-compute[73520]: DEBUG nova.network.neutron [req-38c510ca-bbae-4b1b-9334-ea2005143b6a req-1b573524-a149-4386-b99a-6e79a6b558b6 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:34:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-38c510ca-bbae-4b1b-9334-ea2005143b6a req-1b573524-a149-4386-b99a-6e79a6b558b6 service nova] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Detach interface failed, port_id=8018c557-722c-41a7-91e0-f63bc6568bac, reason: Instance 27659935-6eb3-4cea-9648-f5820cddda98 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:34:16 user nova-compute[73520]: INFO nova.compute.manager [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Took 0.87 seconds to detach 1 volumes for instance.
Aug 16 12:34:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:16 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:34:16 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:34:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:16 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Deleted allocations for instance 27659935-6eb3-4cea-9648-f5820cddda98
Aug 16 12:34:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-fdf959c6-62db-4121-8f3b-b6843e1b6799 tempest-ServerActionsTestOtherB-1849139886 tempest-ServerActionsTestOtherB-1849139886-project-member] Lock "27659935-6eb3-4cea-9648-f5820cddda98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.244s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:28 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189253.7429397, 27659935-6eb3-4cea-9648-f5820cddda98 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:34:28 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] VM Stopped (Lifecycle Event)
Aug 16 12:34:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-02c265b9-5614-4225-97ea-125b40349932 None None] [instance: 27659935-6eb3-4cea-9648-f5820cddda98] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:34:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:31 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:34:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:31 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:34:31 user nova-compute[73520]: INFO nova.compute.claims [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Claim successful on node user
Aug 16 12:34:31 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:34:31 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:34:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:31 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:34:31 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:34:31 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:34:31 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:34:31 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:34:32 user nova-compute[73520]: INFO nova.virt.block_device [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Booting with volume acf4e063-0578-4e92-88ad-c7a8e4bf9679 at /dev/vda
Aug 16 12:34:32 user nova-compute[73520]: DEBUG nova.policy [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8dad9f2c3d7141c884f25d5e9a36f240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7f1193dcd3415ca0e442cf073c7d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG os_brick.utils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e88fb47-04a7-4284-98d7-30bff6c38a2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[54785e83-ba1f-4769-8ef5-0695be48376a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad955f46-eeec-4a7b-9683-35eb5001676c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c465079d-a880-4a52-ae37-396ff73568a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:34:32 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:34:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7d6b37-783f-43c4-b083-aa1cd4edc15b]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG os_brick.utils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updating existing volume attachment record: 82567e61-7bdc-4f77-92eb-ea44282d1e8b {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:34:32 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Successfully created port: 4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:34:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:33 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Successfully updated port: 4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:34:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:34:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquired lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:34:33 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:34:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-492781e8-a062-43b4-8048-6a4c77839181 req-a581c061-c4ea-4428-b5ca-3989c6d3a2d0 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-changed-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:34:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-492781e8-a062-43b4-8048-6a4c77839181 req-a581c061-c4ea-4428-b5ca-3989c6d3a2d0 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Refreshing instance network info cache due to event network-changed-4f15c60a-7230-4011-9f93-15cf877d4bb9. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:34:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-492781e8-a062-43b4-8048-6a4c77839181 req-a581c061-c4ea-4428-b5ca-3989c6d3a2d0 service nova] Acquiring lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:34:33 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:34:34 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updating instance_info_cache with network_info: [{"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:34:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Releasing lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:34:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Instance network_info: |[{"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:34:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-492781e8-a062-43b4-8048-6a4c77839181 req-a581c061-c4ea-4428-b5ca-3989c6d3a2d0 service nova] Acquired lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:34:34 user nova-compute[73520]: DEBUG nova.network.neutron [req-492781e8-a062-43b4-8048-6a4c77839181 req-a581c061-c4ea-4428-b5ca-3989c6d3a2d0 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Refreshing network info cache for port 4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:34:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:34 user nova-compute[73520]: DEBUG nova.network.neutron [req-492781e8-a062-43b4-8048-6a4c77839181 req-a581c061-c4ea-4428-b5ca-3989c6d3a2d0 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updated VIF entry in instance network info cache for port 4f15c60a-7230-4011-9f93-15cf877d4bb9. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:34:34 user nova-compute[73520]: DEBUG nova.network.neutron [req-492781e8-a062-43b4-8048-6a4c77839181 req-a581c061-c4ea-4428-b5ca-3989c6d3a2d0 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updating instance_info_cache with network_info: [{"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:34:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-492781e8-a062-43b4-8048-6a4c77839181 req-a581c061-c4ea-4428-b5ca-3989c6d3a2d0 service nova] Releasing lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:34:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:34:42 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Creating image(s)
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Ensure instance console log exists: /opt/stack/data/nova/instances/87762694-f7bc-44b4-a37b-7f9e11fdd627/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Start _get_guest_xml network_info=[{"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvXdJlwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87762694-f7bc-44b4-a37b-7f9e11fdd627', 'attached_at': '', 'detached_at': '', 'volume_id': 'acf4e063-0578-4e92-88ad-c7a8e4bf9679', 'serial': 'acf4e063-0578-4e92-88ad-c7a8e4bf9679'}, 'attachment_id': '82567e61-7bdc-4f77-92eb-ea44282d1e8b', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:34:42 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:34:42 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:34:42 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvXdJlwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:34:43 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:34:43 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:34:43 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[799a2675-426f-4c69-88e1-b8a8f286d8cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:34:43 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b121e0-2b5a-43ed-99c6-8716d9a8f06e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679] added
Aug 16 12:34:43 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[144c2650-a407-4ee0-b361-654d5b9826af]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0793255-f6b9-4402-8bee-58ad5d3466e3]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvXdJlwW {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvXdJlwW" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f2f18e-7656-4a8d-9223-27e7a6c55bd2]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YvXdJlwW'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b757cbd4-e790-4412-962c-26ee19698451]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d965aa4-f9f3-4565-b843-4aa0380e21a1]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dfbca3-1064-4520-86d1-3497cef688d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260]
Aug 16 12:34:43 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260] successful.
Aug 16 12:34:43 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[155d6bd0-ca8e-41c7-90eb-967fa9a6f6f0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f693b7f5-92a9-4160-81d0-ca2a78baee1a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:34:43 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2528cda7-f450-41a0-ae4e-3c8db4ab9a06]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvXdJlwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:43 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26138656433653833', 'path': '/dev/sde'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138656433653833', 'path': '/dev/sde'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1762968804',display_name='tempest-TestShelveInstance-server-1762968804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1762968804',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0Yb5/yDtg/+xo5Xx2Aj8NIMdu6T6UP+UvyUgQRFiFrHQrxuwRb4TYEqIrdfN8knygXFvaDYnN6hJcknWDLd/V/82hafp7vrTaSbn8yS/kvOhfMvo4bViuQawj8E1al9w==',key_name='tempest-TestShelveInstance-1599693803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af7f1193dcd3415ca0e442cf073c7d92',ramdisk_id='',reservation_id='r-zrcwdju7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1971700305',owner_user_name='tempest-TestShelveInstance-1971700305-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:34:32Z,user_data=None,user_id='8dad9f2c3d7141c884f25d5e9a36f240',uuid=87762694-f7bc-44b4-a37b-7f9e11fdd627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Converting VIF {"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG nova.objects.instance [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lazy-loading 'pci_devices' on Instance uuid 87762694-f7bc-44b4-a37b-7f9e11fdd627 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:34:44 user nova-compute[73520]:   <uuid>87762694-f7bc-44b4-a37b-7f9e11fdd627</uuid>
Aug 16 12:34:44 user nova-compute[73520]:   <name>instance-0000002c</name>
Aug 16 12:34:44 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:34:44 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:34:44 user nova-compute[73520]:   <metadata>
Aug 16 12:34:44 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:34:44 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:34:44 user nova-compute[73520]:       <nova:name>tempest-TestShelveInstance-server-1762968804</nova:name>
Aug 16 12:34:44 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:34:42</nova:creationTime>
Aug 16 12:34:44 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:34:44 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:34:44 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:34:44 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:34:44 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:34:44 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:34:44 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:34:44 user nova-compute[73520]:       <nova:owner>
Aug 16 12:34:44 user nova-compute[73520]:         <nova:user uuid="8dad9f2c3d7141c884f25d5e9a36f240">tempest-TestShelveInstance-1971700305-project-member</nova:user>
Aug 16 12:34:44 user nova-compute[73520]:         <nova:project uuid="af7f1193dcd3415ca0e442cf073c7d92">tempest-TestShelveInstance-1971700305</nova:project>
Aug 16 12:34:44 user nova-compute[73520]:       </nova:owner>
Aug 16 12:34:44 user nova-compute[73520]:       <nova:ports>
Aug 16 12:34:44 user nova-compute[73520]:         <nova:port uuid="4f15c60a-7230-4011-9f93-15cf877d4bb9">
Aug 16 12:34:44 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 12:34:44 user nova-compute[73520]:         </nova:port>
Aug 16 12:34:44 user nova-compute[73520]:       </nova:ports>
Aug 16 12:34:44 user nova-compute[73520]:     </nova:instance>
Aug 16 12:34:44 user nova-compute[73520]:   </metadata>
Aug 16 12:34:44 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:34:44 user nova-compute[73520]:     <system>
Aug 16 12:34:44 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:34:44 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:34:44 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:34:44 user nova-compute[73520]:       <entry name="serial">87762694-f7bc-44b4-a37b-7f9e11fdd627</entry>
Aug 16 12:34:44 user nova-compute[73520]:       <entry name="uuid">87762694-f7bc-44b4-a37b-7f9e11fdd627</entry>
Aug 16 12:34:44 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:34:44 user nova-compute[73520]:     </system>
Aug 16 12:34:44 user nova-compute[73520]:   </sysinfo>
Aug 16 12:34:44 user nova-compute[73520]:   <os>
Aug 16 12:34:44 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:34:44 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:34:44 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:34:44 user nova-compute[73520]:   </os>
Aug 16 12:34:44 user nova-compute[73520]:   <features>
Aug 16 12:34:44 user nova-compute[73520]:     <acpi/>
Aug 16 12:34:44 user nova-compute[73520]:     <apic/>
Aug 16 12:34:44 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:34:44 user nova-compute[73520]:   </features>
Aug 16 12:34:44 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:34:44 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:34:44 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:34:44 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:34:44 user nova-compute[73520]:   </clock>
Aug 16 12:34:44 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:34:44 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:34:44 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:34:44 user nova-compute[73520]:   </cpu>
Aug 16 12:34:44 user nova-compute[73520]:   <devices>
Aug 16 12:34:44 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:34:44 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:34:44 user nova-compute[73520]:       <source dev="/dev/sde"/>
Aug 16 12:34:44 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:34:44 user nova-compute[73520]:       <serial>acf4e063-0578-4e92-88ad-c7a8e4bf9679</serial>
Aug 16 12:34:44 user nova-compute[73520]:     </disk>
Aug 16 12:34:44 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:34:44 user nova-compute[73520]:       <mac address="fa:16:3e:a0:5c:00"/>
Aug 16 12:34:44 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:34:44 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:34:44 user nova-compute[73520]:       <target dev="tap4f15c60a-72"/>
Aug 16 12:34:44 user nova-compute[73520]:     </interface>
Aug 16 12:34:44 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:34:44 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/87762694-f7bc-44b4-a37b-7f9e11fdd627/console.log" append="off"/>
Aug 16 12:34:44 user nova-compute[73520]:     </serial>
Aug 16 12:34:44 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:34:44 user nova-compute[73520]:     <video>
Aug 16 12:34:44 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:34:44 user nova-compute[73520]:     </video>
Aug 16 12:34:44 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:34:44 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:34:44 user nova-compute[73520]:     </rng>
Aug 16 12:34:44 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:34:44 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:34:44 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:34:44 user nova-compute[73520]:     </memballoon>
Aug 16 12:34:44 user nova-compute[73520]:   </devices>
Aug 16 12:34:44 user nova-compute[73520]: </domain>
Aug 16 12:34:44 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1762968804',display_name='tempest-TestShelveInstance-server-1762968804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1762968804',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0Yb5/yDtg/+xo5Xx2Aj8NIMdu6T6UP+UvyUgQRFiFrHQrxuwRb4TYEqIrdfN8knygXFvaDYnN6hJcknWDLd/V/82hafp7vrTaSbn8yS/kvOhfMvo4bViuQawj8E1al9w==',key_name='tempest-TestShelveInstance-1599693803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af7f1193dcd3415ca0e442cf073c7d92',ramdisk_id='',reservation_id='r-zrcwdju7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1971700305',owner_user_name='tempest-TestShelveInstance-1971700305-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:34:32Z,user_data=None,user_id='8dad9f2c3d7141c884f25d5e9a36f240',uuid=87762694-f7bc-44b4-a37b-7f9e11fdd627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Converting VIF {"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG os_vif [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f15c60a-72, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f15c60a-72, col_values=(('external_ids', {'iface-id': '4f15c60a-7230-4011-9f93-15cf877d4bb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:5c:00', 'vm-uuid': '87762694-f7bc-44b4-a37b-7f9e11fdd627'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:44 user nova-compute[73520]: INFO os_vif [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72')
Aug 16 12:34:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] No VIF found with MAC fa:16:3e:a0:5c:00, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:34:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:34:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:34:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-c78c94b4-fae6-4e1f-b44e-e8cc875dcb5d req-471fbeaa-3ae1-4d6a-8157-414bc9051298 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:34:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c78c94b4-fae6-4e1f-b44e-e8cc875dcb5d req-471fbeaa-3ae1-4d6a-8157-414bc9051298 service nova] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c78c94b4-fae6-4e1f-b44e-e8cc875dcb5d req-471fbeaa-3ae1-4d6a-8157-414bc9051298 service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c78c94b4-fae6-4e1f-b44e-e8cc875dcb5d req-471fbeaa-3ae1-4d6a-8157-414bc9051298 service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-c78c94b4-fae6-4e1f-b44e-e8cc875dcb5d req-471fbeaa-3ae1-4d6a-8157-414bc9051298 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] No waiting events found dispatching network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:34:46 user nova-compute[73520]: WARNING nova.compute.manager [req-c78c94b4-fae6-4e1f-b44e-e8cc875dcb5d req-471fbeaa-3ae1-4d6a-8157-414bc9051298 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received unexpected event network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 for instance with vm_state building and task_state spawning.
Aug 16 12:34:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189288.0168219, 87762694-f7bc-44b4-a37b-7f9e11fdd627 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:34:48 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] VM Resumed (Lifecycle Event)
Aug 16 12:34:48 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Instance spawned successfully.
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:34:48 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189288.0170453, 87762694-f7bc-44b4-a37b-7f9e11fdd627 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:34:48 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] VM Started (Lifecycle Event)
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-4f68cc24-0dc6-4b86-a5ba-abc95201ab1f req-07861a1c-b22b-4a99-aa12-600d1be2e16d service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4f68cc24-0dc6-4b86-a5ba-abc95201ab1f req-07861a1c-b22b-4a99-aa12-600d1be2e16d service nova] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4f68cc24-0dc6-4b86-a5ba-abc95201ab1f req-07861a1c-b22b-4a99-aa12-600d1be2e16d service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4f68cc24-0dc6-4b86-a5ba-abc95201ab1f req-07861a1c-b22b-4a99-aa12-600d1be2e16d service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-4f68cc24-0dc6-4b86-a5ba-abc95201ab1f req-07861a1c-b22b-4a99-aa12-600d1be2e16d service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] No waiting events found dispatching network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:34:48 user nova-compute[73520]: WARNING nova.compute.manager [req-4f68cc24-0dc6-4b86-a5ba-abc95201ab1f req-07861a1c-b22b-4a99-aa12-600d1be2e16d service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received unexpected event network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 for instance with vm_state building and task_state spawning.
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:34:48 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:34:48 user nova-compute[73520]: INFO nova.compute.manager [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Took 5.52 seconds to spawn the instance on the hypervisor.
Aug 16 12:34:48 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:34:48 user nova-compute[73520]: INFO nova.compute.manager [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Took 17.10 seconds to build instance.
Aug 16 12:34:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6d06787b-f77c-468e-a2c9-397658b54e24 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.194s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:50 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:34:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:50 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:34:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:34:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:34:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG nova.compute.manager [req-173dc83d-412a-43e6-a597-8cbb572a1b49 req-31e8e475-9826-41d6-81ce-03a23425e524 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-changed-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG nova.compute.manager [req-173dc83d-412a-43e6-a597-8cbb572a1b49 req-31e8e475-9826-41d6-81ce-03a23425e524 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Refreshing instance network info cache due to event network-changed-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-173dc83d-412a-43e6-a597-8cbb572a1b49 req-31e8e475-9826-41d6-81ce-03a23425e524 service nova] Acquiring lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-173dc83d-412a-43e6-a597-8cbb572a1b49 req-31e8e475-9826-41d6-81ce-03a23425e524 service nova] Acquired lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG nova.network.neutron [req-173dc83d-412a-43e6-a597-8cbb572a1b49 req-31e8e475-9826-41d6-81ce-03a23425e524 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Refreshing network info cache for port 6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG nova.network.neutron [req-173dc83d-412a-43e6-a597-8cbb572a1b49 req-31e8e475-9826-41d6-81ce-03a23425e524 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updated VIF entry in instance network info cache for port 6e7cef18-ea49-45cb-a7e8-3e5292b6f48f. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG nova.network.neutron [req-173dc83d-412a-43e6-a597-8cbb572a1b49 req-31e8e475-9826-41d6-81ce-03a23425e524 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updating instance_info_cache with network_info: [{"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-173dc83d-412a-43e6-a597-8cbb572a1b49 req-31e8e475-9826-41d6-81ce-03a23425e524 service nova] Releasing lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:54 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:34:54 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7436MB free_disk=25.084339141845703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d712e605-8ee2-4bd5-adce-61d0f284c835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 25b02048-2937-440a-9809-eceeb3558856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 52275f84-b38b-4351-befe-9052b1e02612 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ce0355be-8b0e-4c8c-b052-10ac730fa6cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 26b0286b-9021-4859-88ac-760e7249a3d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1bc7c0ce-c03c-4941-bdde-2506e7c51559 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 87762694-f7bc-44b4-a37b-7f9e11fdd627 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:34:54 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:34:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:34:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:34:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:34:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:34:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:34:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:34:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:34:56 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:34:56 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Updating instance_info_cache with network_info: [{"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:34:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-4926037c-8e89-4923-940f-9837b053b9a0" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:34:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'flavor' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:34:59 user nova-compute[73520]: INFO nova.compute.manager [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Attaching volume f400539b-2944-4af4-b254-9ec43bfd6057 to /dev/vdb
Aug 16 12:34:59 user nova-compute[73520]: DEBUG os_brick.utils [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[646e24da-c48f-4303-8780-decfbfb8eba7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9ffa05-9b3b-41a4-b24b-920cbb803970]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed34a92-fce6-4b95-a7a0-be6234a3f8f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0c9fc0-bc13-43a3-b89c-69b2e3d09f45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:34:59 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:34:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ad8cd5-30be-496e-9b41-357d49739bf0]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG os_brick.utils [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:34:59 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updating existing volume attachment record: a68f86c3-1259-4613-ae64-f2079b02b3e6 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:35:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:35:08 user nova-compute[73520]: INFO nova.compute.claims [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Claim successful on node user
Aug 16 12:35:08 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:35:08 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:35:08 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:35:08 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Creating image(s)
Aug 16 12:35:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "/opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "/opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG nova.policy [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d1fb48f56ed426b8cc984a7973ab208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1870ba83d8124a6c9624afde2cdd3752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.169s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk 1073741824" returned: 0 in 0.060s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Cannot resize image /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG nova.objects.instance [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lazy-loading 'migration_context' on Instance uuid 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Ensure instance console log exists: /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:10 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Successfully created port: b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJBPsaTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:35:11 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:35:11 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:35:11 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[86056a01-6c6f-41a3-a0c9-a6530dbbfd41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:35:11 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63708e7-1f75-4320-8278-3d5bd55720e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057] added
Aug 16 12:35:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e424803-ffda-4a1f-a5a3-dd56f0148b83]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3adcde-d5d0-4792-8722-5a2b1ebf9da5]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJBPsaTX {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJBPsaTX" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0536a2-97bc-4948-947f-2759af8328be]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qJBPsaTX'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[46572e06-f8d3-44f5-a4f7-ba0799ccb140]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c9324-5cf6-4481-bfbb-b16fbf05a28c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3484244-d1f9-473d-9c3d-be2f3bf1456a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260]
Aug 16 12:35:11 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260] successful.
Aug 16 12:35:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d814a1a0-02fa-4166-861a-63e5f7214db7]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6ad422-7afe-4ccc-b2bb-8e671751a26c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:35:11 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] HCTL ('38', '-', '-', 0) found on session 49 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed4cf83-89ff-452d-a793-1233d4ed3c62]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:11 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching for a device in session 49 and hctl ['38', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-952de02c-d14f-457c-97e1-b30c001dd3d0 req-6817b83f-3b6e-43bc-8e20-59ab770d622f service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Received event network-changed-98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.compute.manager [req-952de02c-d14f-457c-97e1-b30c001dd3d0 req-6817b83f-3b6e-43bc-8e20-59ab770d622f service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Refreshing instance network info cache due to event network-changed-98cd61dd-3051-41f3-bb39-c107faea4fc0. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-952de02c-d14f-457c-97e1-b30c001dd3d0 req-6817b83f-3b6e-43bc-8e20-59ab770d622f service nova] Acquiring lock "refresh_cache-1bc7c0ce-c03c-4941-bdde-2506e7c51559" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-952de02c-d14f-457c-97e1-b30c001dd3d0 req-6817b83f-3b6e-43bc-8e20-59ab770d622f service nova] Acquired lock "refresh_cache-1bc7c0ce-c03c-4941-bdde-2506e7c51559" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.network.neutron [req-952de02c-d14f-457c-97e1-b30c001dd3d0 req-6817b83f-3b6e-43bc-8e20-59ab770d622f service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Refreshing network info cache for port 98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Successfully updated port: b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "refresh_cache-1e3d30e6-7800-4dd9-88ae-6abe48c980e5" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquired lock "refresh_cache-1e3d30e6-7800-4dd9-88ae-6abe48c980e5" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching for a device in session 49 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJBPsaTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '26338303366376231', 'path': '/dev/sdg'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338303366376231', 'path': '/dev/sdg'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'flavor' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:35:12 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:35:12 user nova-compute[73520]:   <source dev="/dev/sdg"/>
Aug 16 12:35:12 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:35:12 user nova-compute[73520]:   <serial>f400539b-2944-4af4-b254-9ec43bfd6057</serial>
Aug 16 12:35:12 user nova-compute[73520]: </disk>
Aug 16 12:35:12 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Updating instance_info_cache with network_info: [{"id": "b24cb0a1-1a5f-4285-a039-d96713541f95", "address": "fa:16:3e:63:af:75", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24cb0a1-1a", "ovs_interfaceid": "b24cb0a1-1a5f-4285-a039-d96713541f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Releasing lock "refresh_cache-1e3d30e6-7800-4dd9-88ae-6abe48c980e5" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Instance network_info: |[{"id": "b24cb0a1-1a5f-4285-a039-d96713541f95", "address": "fa:16:3e:63:af:75", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24cb0a1-1a", "ovs_interfaceid": "b24cb0a1-1a5f-4285-a039-d96713541f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Start _get_guest_xml network_info=[{"id": "b24cb0a1-1a5f-4285-a039-d96713541f95", "address": "fa:16:3e:63:af:75", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24cb0a1-1a", "ovs_interfaceid": "b24cb0a1-1a5f-4285-a039-d96713541f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:35:12 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:35:12 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1632601042',display_name='tempest-VolumesSnapshotTestJSON-instance-1632601042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1632601042',id=45,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFMHcAITaSfVXToHLw2ue7G5El/M7lYEyUhAqjgcbcAAhsdEEjlOrfPVNhpVkPIjS21sPgvk7Oxba1oX1toJGXC66nsoxdAImo8RGlKpY7AFEqa3xcfbNOQSgO7LO9vnQ==',key_name='tempest-keypair-1854279134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1870ba83d8124a6c9624afde2cdd3752',ramdisk_id='',reservation_id='r-kc2rjjf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1304228647',owner_user_name='tempest-VolumesSnapshotTestJSON-1304228647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:35:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d1fb48f56ed426b8cc984a7973ab208',uuid=1e3d30e6-7800-4dd9-88ae-6abe48c980e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b24cb0a1-1a5f-4285-a039-d96713541f95", "address": "fa:16:3e:63:af:75", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24cb0a1-1a", "ovs_interfaceid": "b24cb0a1-1a5f-4285-a039-d96713541f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Converting VIF {"id": "b24cb0a1-1a5f-4285-a039-d96713541f95", "address": "fa:16:3e:63:af:75", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24cb0a1-1a", "ovs_interfaceid": "b24cb0a1-1a5f-4285-a039-d96713541f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:af:75,bridge_name='br-int',has_traffic_filtering=True,id=b24cb0a1-1a5f-4285-a039-d96713541f95,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24cb0a1-1a') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.objects.instance [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:35:12 user nova-compute[73520]:   <uuid>1e3d30e6-7800-4dd9-88ae-6abe48c980e5</uuid>
Aug 16 12:35:12 user nova-compute[73520]:   <name>instance-0000002d</name>
Aug 16 12:35:12 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:35:12 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:35:12 user nova-compute[73520]:   <metadata>
Aug 16 12:35:12 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:35:12 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:35:12 user nova-compute[73520]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1632601042</nova:name>
Aug 16 12:35:12 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:35:12</nova:creationTime>
Aug 16 12:35:12 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:35:12 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:35:12 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:35:12 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:35:12 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:35:12 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:35:12 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:35:12 user nova-compute[73520]:       <nova:owner>
Aug 16 12:35:12 user nova-compute[73520]:         <nova:user uuid="5d1fb48f56ed426b8cc984a7973ab208">tempest-VolumesSnapshotTestJSON-1304228647-project-member</nova:user>
Aug 16 12:35:12 user nova-compute[73520]:         <nova:project uuid="1870ba83d8124a6c9624afde2cdd3752">tempest-VolumesSnapshotTestJSON-1304228647</nova:project>
Aug 16 12:35:12 user nova-compute[73520]:       </nova:owner>
Aug 16 12:35:12 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:35:12 user nova-compute[73520]:       <nova:ports>
Aug 16 12:35:12 user nova-compute[73520]:         <nova:port uuid="b24cb0a1-1a5f-4285-a039-d96713541f95">
Aug 16 12:35:12 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 12:35:12 user nova-compute[73520]:         </nova:port>
Aug 16 12:35:12 user nova-compute[73520]:       </nova:ports>
Aug 16 12:35:12 user nova-compute[73520]:     </nova:instance>
Aug 16 12:35:12 user nova-compute[73520]:   </metadata>
Aug 16 12:35:12 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:35:12 user nova-compute[73520]:     <system>
Aug 16 12:35:12 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:35:12 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:35:12 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:35:12 user nova-compute[73520]:       <entry name="serial">1e3d30e6-7800-4dd9-88ae-6abe48c980e5</entry>
Aug 16 12:35:12 user nova-compute[73520]:       <entry name="uuid">1e3d30e6-7800-4dd9-88ae-6abe48c980e5</entry>
Aug 16 12:35:12 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:35:12 user nova-compute[73520]:     </system>
Aug 16 12:35:12 user nova-compute[73520]:   </sysinfo>
Aug 16 12:35:12 user nova-compute[73520]:   <os>
Aug 16 12:35:12 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:35:12 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:35:12 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:35:12 user nova-compute[73520]:   </os>
Aug 16 12:35:12 user nova-compute[73520]:   <features>
Aug 16 12:35:12 user nova-compute[73520]:     <acpi/>
Aug 16 12:35:12 user nova-compute[73520]:     <apic/>
Aug 16 12:35:12 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:35:12 user nova-compute[73520]:   </features>
Aug 16 12:35:12 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:35:12 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:35:12 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:35:12 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:35:12 user nova-compute[73520]:   </clock>
Aug 16 12:35:12 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:35:12 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:35:12 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:35:12 user nova-compute[73520]:   </cpu>
Aug 16 12:35:12 user nova-compute[73520]:   <devices>
Aug 16 12:35:12 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:35:12 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:35:12 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk"/>
Aug 16 12:35:12 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:35:12 user nova-compute[73520]:     </disk>
Aug 16 12:35:12 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:35:12 user nova-compute[73520]:       <mac address="fa:16:3e:63:af:75"/>
Aug 16 12:35:12 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:35:12 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:35:12 user nova-compute[73520]:       <target dev="tapb24cb0a1-1a"/>
Aug 16 12:35:12 user nova-compute[73520]:     </interface>
Aug 16 12:35:12 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:35:12 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/console.log" append="off"/>
Aug 16 12:35:12 user nova-compute[73520]:     </serial>
Aug 16 12:35:12 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:35:12 user nova-compute[73520]:     <video>
Aug 16 12:35:12 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:35:12 user nova-compute[73520]:     </video>
Aug 16 12:35:12 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:35:12 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:35:12 user nova-compute[73520]:     </rng>
Aug 16 12:35:12 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:35:12 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:35:12 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:35:12 user nova-compute[73520]:     </memballoon>
Aug 16 12:35:12 user nova-compute[73520]:   </devices>
Aug 16 12:35:12 user nova-compute[73520]: </domain>
Aug 16 12:35:12 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1632601042',display_name='tempest-VolumesSnapshotTestJSON-instance-1632601042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1632601042',id=45,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFMHcAITaSfVXToHLw2ue7G5El/M7lYEyUhAqjgcbcAAhsdEEjlOrfPVNhpVkPIjS21sPgvk7Oxba1oX1toJGXC66nsoxdAImo8RGlKpY7AFEqa3xcfbNOQSgO7LO9vnQ==',key_name='tempest-keypair-1854279134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1870ba83d8124a6c9624afde2cdd3752',ramdisk_id='',reservation_id='r-kc2rjjf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1304228647',owner_user_name='tempest-VolumesSnapshotTestJSON-1304228647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:35:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d1fb48f56ed426b8cc984a7973ab208',uuid=1e3d30e6-7800-4dd9-88ae-6abe48c980e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b24cb0a1-1a5f-4285-a039-d96713541f95", "address": "fa:16:3e:63:af:75", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24cb0a1-1a", "ovs_interfaceid": "b24cb0a1-1a5f-4285-a039-d96713541f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Converting VIF {"id": "b24cb0a1-1a5f-4285-a039-d96713541f95", "address": "fa:16:3e:63:af:75", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24cb0a1-1a", "ovs_interfaceid": "b24cb0a1-1a5f-4285-a039-d96713541f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:af:75,bridge_name='br-int',has_traffic_filtering=True,id=b24cb0a1-1a5f-4285-a039-d96713541f95,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24cb0a1-1a') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG os_vif [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:af:75,bridge_name='br-int',has_traffic_filtering=True,id=b24cb0a1-1a5f-4285-a039-d96713541f95,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24cb0a1-1a') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb24cb0a1-1a, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb24cb0a1-1a, col_values=(('external_ids', {'iface-id': 'b24cb0a1-1a5f-4285-a039-d96713541f95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:af:75', 'vm-uuid': '1e3d30e6-7800-4dd9-88ae-6abe48c980e5'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:35:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:12 user nova-compute[73520]: INFO os_vif [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:af:75,bridge_name='br-int',has_traffic_filtering=True,id=b24cb0a1-1a5f-4285-a039-d96713541f95,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24cb0a1-1a')
Aug 16 12:35:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:35:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] No VIF found with MAC fa:16:3e:63:af:75, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:35:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:35:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:35:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No VIF found with MAC fa:16:3e:25:5f:15, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:35:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f62199d1-22ff-4adf-aeab-675e520baacf tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:13 user nova-compute[73520]: DEBUG nova.network.neutron [req-952de02c-d14f-457c-97e1-b30c001dd3d0 req-6817b83f-3b6e-43bc-8e20-59ab770d622f service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Updated VIF entry in instance network info cache for port 98cd61dd-3051-41f3-bb39-c107faea4fc0. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:35:13 user nova-compute[73520]: DEBUG nova.network.neutron [req-952de02c-d14f-457c-97e1-b30c001dd3d0 req-6817b83f-3b6e-43bc-8e20-59ab770d622f service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Updating instance_info_cache with network_info: [{"id": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "address": "fa:16:3e:f1:11:70", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd61dd-30", "ovs_interfaceid": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:35:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-952de02c-d14f-457c-97e1-b30c001dd3d0 req-6817b83f-3b6e-43bc-8e20-59ab770d622f service nova] Releasing lock "refresh_cache-1bc7c0ce-c03c-4941-bdde-2506e7c51559" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-38d020d8-f603-4856-8b27-6ece86e3e084 req-5c66308b-50d6-457c-bfd4-7f098b30198f service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Received event network-changed-98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-38d020d8-f603-4856-8b27-6ece86e3e084 req-5c66308b-50d6-457c-bfd4-7f098b30198f service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Refreshing instance network info cache due to event network-changed-98cd61dd-3051-41f3-bb39-c107faea4fc0. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-38d020d8-f603-4856-8b27-6ece86e3e084 req-5c66308b-50d6-457c-bfd4-7f098b30198f service nova] Acquiring lock "refresh_cache-1bc7c0ce-c03c-4941-bdde-2506e7c51559" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-38d020d8-f603-4856-8b27-6ece86e3e084 req-5c66308b-50d6-457c-bfd4-7f098b30198f service nova] Acquired lock "refresh_cache-1bc7c0ce-c03c-4941-bdde-2506e7c51559" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-38d020d8-f603-4856-8b27-6ece86e3e084 req-5c66308b-50d6-457c-bfd4-7f098b30198f service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Refreshing network info cache for port 98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-d3243003-3248-4b90-a238-dfcfe4a40f82 req-2f299642-1dad-47f3-8b43-13bb5d0d38cf service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Received event network-changed-b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-d3243003-3248-4b90-a238-dfcfe4a40f82 req-2f299642-1dad-47f3-8b43-13bb5d0d38cf service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Refreshing instance network info cache due to event network-changed-b24cb0a1-1a5f-4285-a039-d96713541f95. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d3243003-3248-4b90-a238-dfcfe4a40f82 req-2f299642-1dad-47f3-8b43-13bb5d0d38cf service nova] Acquiring lock "refresh_cache-1e3d30e6-7800-4dd9-88ae-6abe48c980e5" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d3243003-3248-4b90-a238-dfcfe4a40f82 req-2f299642-1dad-47f3-8b43-13bb5d0d38cf service nova] Acquired lock "refresh_cache-1e3d30e6-7800-4dd9-88ae-6abe48c980e5" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-d3243003-3248-4b90-a238-dfcfe4a40f82 req-2f299642-1dad-47f3-8b43-13bb5d0d38cf service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Refreshing network info cache for port b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:14 user nova-compute[73520]: INFO nova.compute.manager [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Terminating instance
Aug 16 12:35:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-38d020d8-f603-4856-8b27-6ece86e3e084 req-5c66308b-50d6-457c-bfd4-7f098b30198f service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Updated VIF entry in instance network info cache for port 98cd61dd-3051-41f3-bb39-c107faea4fc0. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:35:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-38d020d8-f603-4856-8b27-6ece86e3e084 req-5c66308b-50d6-457c-bfd4-7f098b30198f service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Updating instance_info_cache with network_info: [{"id": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "address": "fa:16:3e:f1:11:70", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd61dd-30", "ovs_interfaceid": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-d36a7765-90c0-4696-a83b-402d7310ab77 req-b32f0da3-6ce6-474b-b59e-acb3f36f7910 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Received event network-vif-unplugged-98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d36a7765-90c0-4696-a83b-402d7310ab77 req-b32f0da3-6ce6-474b-b59e-acb3f36f7910 service nova] Acquiring lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d36a7765-90c0-4696-a83b-402d7310ab77 req-b32f0da3-6ce6-474b-b59e-acb3f36f7910 service nova] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d36a7765-90c0-4696-a83b-402d7310ab77 req-b32f0da3-6ce6-474b-b59e-acb3f36f7910 service nova] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-d36a7765-90c0-4696-a83b-402d7310ab77 req-b32f0da3-6ce6-474b-b59e-acb3f36f7910 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] No waiting events found dispatching network-vif-unplugged-98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-d36a7765-90c0-4696-a83b-402d7310ab77 req-b32f0da3-6ce6-474b-b59e-acb3f36f7910 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Received event network-vif-unplugged-98cd61dd-3051-41f3-bb39-c107faea4fc0 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-38d020d8-f603-4856-8b27-6ece86e3e084 req-5c66308b-50d6-457c-bfd4-7f098b30198f service nova] Releasing lock "refresh_cache-1bc7c0ce-c03c-4941-bdde-2506e7c51559" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-bf7aca10-ec75-4650-aaf3-acfcf96d0dbc tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-bf7aca10-ec75-4650-aaf3-acfcf96d0dbc tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG nova.compute.manager [None req-bf7aca10-ec75-4650-aaf3-acfcf96d0dbc tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG nova.compute.manager [None req-bf7aca10-ec75-4650-aaf3-acfcf96d0dbc tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73520) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG nova.objects.instance [None req-bf7aca10-ec75-4650-aaf3-acfcf96d0dbc tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'flavor' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG nova.network.neutron [req-d3243003-3248-4b90-a238-dfcfe4a40f82 req-2f299642-1dad-47f3-8b43-13bb5d0d38cf service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Updated VIF entry in instance network info cache for port b24cb0a1-1a5f-4285-a039-d96713541f95. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG nova.network.neutron [req-d3243003-3248-4b90-a238-dfcfe4a40f82 req-2f299642-1dad-47f3-8b43-13bb5d0d38cf service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Updating instance_info_cache with network_info: [{"id": "b24cb0a1-1a5f-4285-a039-d96713541f95", "address": "fa:16:3e:63:af:75", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24cb0a1-1a", "ovs_interfaceid": "b24cb0a1-1a5f-4285-a039-d96713541f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d3243003-3248-4b90-a238-dfcfe4a40f82 req-2f299642-1dad-47f3-8b43-13bb5d0d38cf service nova] Releasing lock "refresh_cache-1e3d30e6-7800-4dd9-88ae-6abe48c980e5" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:15 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Instance destroyed successfully.
Aug 16 12:35:15 user nova-compute[73520]: DEBUG nova.objects.instance [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lazy-loading 'resources' on Instance uuid 1bc7c0ce-c03c-4941-bdde-2506e7c51559 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:33:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2067372450',display_name='tempest-TestVolumeBootPattern-server-2067372450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2067372450',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJr/o6vrVZnxmYhfYixlxoifuhCtvsj5vKkg3ZAc0JSOeGoo3PmY57Yx5t3KGcWwXVP9aD5zqccktnbo7190qT8/kMlT5jQNhZVEjx4vkSe9H5//tD72sKPKPHQkEbRmQ==',key_name='tempest-TestVolumeBootPattern-586845281',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:33:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-5sg9qal0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:33:35Z,user_data=None,user_id='17ed1823b0de433ab523470e235fdd72',uuid=1bc7c0ce-c03c-4941-bdde-2506e7c51559,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "address": "fa:16:3e:f1:11:70", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd61dd-30", "ovs_interfaceid": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "address": "fa:16:3e:f1:11:70", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd61dd-30", "ovs_interfaceid": "98cd61dd-3051-41f3-bb39-c107faea4fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:11:70,bridge_name='br-int',has_traffic_filtering=True,id=98cd61dd-3051-41f3-bb39-c107faea4fc0,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd61dd-30') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_vif [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:11:70,bridge_name='br-int',has_traffic_filtering=True,id=98cd61dd-3051-41f3-bb39-c107faea4fc0,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd61dd-30') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98cd61dd-30, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:15 user nova-compute[73520]: INFO os_vif [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:11:70,bridge_name='br-int',has_traffic_filtering=True,id=98cd61dd-3051-41f3-bb39-c107faea4fc0,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd61dd-30')
Aug 16 12:35:15 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdhTaJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:35:15 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a37642e-396b-462b-a0a6-f6a7d8b4627b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[041b0c9c-d2e9-4063-99ac-b0991ff1a5bc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:35:15 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:35:15 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:35:15 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:35:15 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:35:15 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:35:15 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:35:15 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:35:15 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:35:15 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:35:15 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:35:15 user nova-compute[73520]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 (non-flash)
Aug 16 12:35:15 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:35:15 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:35:15 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c121c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134'): ({'sdh'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Removing single pathed devices sdh {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe20754-66a3-4b3f-9870-d316e3bd4dfa]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2651006-8428-497a-a332-3db2d481c6e9]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flushing IO for device /dev/sdh {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c4e607-a596-4a36-b649-c1384a8ba5f6]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d750b642-d13e-4d05-b5a6-7a7ed933c19c]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] SCSI volumes sdh have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6830abd9-fbbc-4489-ad6b-21bcb86e31ba]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27a63ec-4031-4941-8612-5fc985231416]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134, portal: 172.16.0.220,3260]
Aug 16 12:35:15 user nova-compute[73520]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134, portal: 172.16.0.220,3260] successful.
Aug 16 12:35:15 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fde75cea-4dea-45af-aa11-ef2d3f4c9134 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e104164-a08f-4084-b260-94eea24770c0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== disconnect_volume: return (377ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:35:16 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Deleting instance files /opt/stack/data/nova/instances/1bc7c0ce-c03c-4941-bdde-2506e7c51559_del
Aug 16 12:35:16 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Deletion of /opt/stack/data/nova/instances/1bc7c0ce-c03c-4941-bdde-2506e7c51559_del complete
Aug 16 12:35:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:16 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Instance destroyed successfully.
Aug 16 12:35:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-bf7aca10-ec75-4650-aaf3-acfcf96d0dbc tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:35:16 user nova-compute[73520]: INFO nova.compute.manager [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Took 1.89 seconds to destroy the instance on the hypervisor.
Aug 16 12:35:16 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-86db0aff-51ce-403d-869f-ec49c9b46a33 req-ddd8fb56-3ac0-4ae9-a74f-e640d6b3ea29 service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Received event network-vif-plugged-b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-86db0aff-51ce-403d-869f-ec49c9b46a33 req-ddd8fb56-3ac0-4ae9-a74f-e640d6b3ea29 service nova] Acquiring lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-86db0aff-51ce-403d-869f-ec49c9b46a33 req-ddd8fb56-3ac0-4ae9-a74f-e640d6b3ea29 service nova] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-86db0aff-51ce-403d-869f-ec49c9b46a33 req-ddd8fb56-3ac0-4ae9-a74f-e640d6b3ea29 service nova] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-86db0aff-51ce-403d-869f-ec49c9b46a33 req-ddd8fb56-3ac0-4ae9-a74f-e640d6b3ea29 service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] No waiting events found dispatching network-vif-plugged-b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:35:16 user nova-compute[73520]: WARNING nova.compute.manager [req-86db0aff-51ce-403d-869f-ec49c9b46a33 req-ddd8fb56-3ac0-4ae9-a74f-e640d6b3ea29 service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Received unexpected event network-vif-plugged-b24cb0a1-1a5f-4285-a039-d96713541f95 for instance with vm_state building and task_state spawning.
Aug 16 12:35:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-86db0aff-51ce-403d-869f-ec49c9b46a33 req-ddd8fb56-3ac0-4ae9-a74f-e640d6b3ea29 service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Received event network-vif-plugged-b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-86db0aff-51ce-403d-869f-ec49c9b46a33 req-ddd8fb56-3ac0-4ae9-a74f-e640d6b3ea29 service nova] Acquiring lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-86db0aff-51ce-403d-869f-ec49c9b46a33 req-ddd8fb56-3ac0-4ae9-a74f-e640d6b3ea29 service nova] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-86db0aff-51ce-403d-869f-ec49c9b46a33 req-ddd8fb56-3ac0-4ae9-a74f-e640d6b3ea29 service nova] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-86db0aff-51ce-403d-869f-ec49c9b46a33 req-ddd8fb56-3ac0-4ae9-a74f-e640d6b3ea29 service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] No waiting events found dispatching network-vif-plugged-b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:35:16 user nova-compute[73520]: WARNING nova.compute.manager [req-86db0aff-51ce-403d-869f-ec49c9b46a33 req-ddd8fb56-3ac0-4ae9-a74f-e640d6b3ea29 service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Received unexpected event network-vif-plugged-b24cb0a1-1a5f-4285-a039-d96713541f95 for instance with vm_state building and task_state spawning.
Aug 16 12:35:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-bf7aca10-ec75-4650-aaf3-acfcf96d0dbc tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.100s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:16 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:35:16 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Took 0.60 seconds to deallocate network for instance.
Aug 16 12:35:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-5fead7e8-f1bf-459a-9fb2-07329016c142 req-ffc7ddf2-b23c-4e62-89d3-2d46862a7244 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Received event network-vif-deleted-98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Received event network-vif-plugged-98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] Acquiring lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] No waiting events found dispatching network-vif-plugged-98cd61dd-3051-41f3-bb39-c107faea4fc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:35:17 user nova-compute[73520]: WARNING nova.compute.manager [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Received unexpected event network-vif-plugged-98cd61dd-3051-41f3-bb39-c107faea4fc0 for instance with vm_state active and task_state deleting.
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-unplugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] No waiting events found dispatching network-vif-unplugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:35:17 user nova-compute[73520]: WARNING nova.compute.manager [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received unexpected event network-vif-unplugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f for instance with vm_state stopped and task_state None.
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] No waiting events found dispatching network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:35:17 user nova-compute[73520]: WARNING nova.compute.manager [req-e8458219-cdc6-453c-8704-c141292beb5e req-81c6409d-c0b1-42ad-973b-05d99fd376e9 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received unexpected event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f for instance with vm_state stopped and task_state None.
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189317.5685925, 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:35:17 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] VM Resumed (Lifecycle Event)
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:35:17 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Instance spawned successfully.
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:35:17 user nova-compute[73520]: INFO nova.compute.manager [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Took 0.83 seconds to detach 1 volumes for instance.
Aug 16 12:35:17 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189317.5700016, 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:35:17 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] VM Started (Lifecycle Event)
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:35:17 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:35:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:17 user nova-compute[73520]: INFO nova.compute.manager [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Took 8.97 seconds to spawn the instance on the hypervisor.
Aug 16 12:35:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:35:17 user nova-compute[73520]: INFO nova.compute.manager [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Took 9.86 seconds to build instance.
Aug 16 12:35:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2e23e29e-70ed-494a-8da7-0f655f301a4a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.958s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:18 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:35:18 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:35:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:18 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Deleted allocations for instance 1bc7c0ce-c03c-4941-bdde-2506e7c51559
Aug 16 12:35:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-29494162-c046-42fb-b83f-ffed5daf9fff tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "1bc7c0ce-c03c-4941-bdde-2506e7c51559" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.978s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:30 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189315.5213928, 1bc7c0ce-c03c-4941-bdde-2506e7c51559 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:35:30 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] VM Stopped (Lifecycle Event)
Aug 16 12:35:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-bbd7ff00-b758-4fc5-ad6e-237754658dc6 None None] [instance: 1bc7c0ce-c03c-4941-bdde-2506e7c51559] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:35:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:35:31 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189316.1588774, 26b0286b-9021-4859-88ac-760e7249a3d2 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:35:31 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] VM Stopped (Lifecycle Event)
Aug 16 12:35:31 user nova-compute[73520]: DEBUG nova.compute.manager [None req-899ce034-da19-42e9-86e3-11588bd1b2f8 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:35:31 user nova-compute[73520]: DEBUG nova.compute.manager [None req-899ce034-da19-42e9-86e3-11588bd1b2f8 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:35:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:35:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:35:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:35:43 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:35:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:35:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:35:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "52275f84-b38b-4351-befe-9052b1e02612" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:45 user nova-compute[73520]: INFO nova.compute.manager [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Terminating instance
Aug 16 12:35:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-50128375-af64-4ce5-bc0e-16cbb599a59d req-292b5db7-01f6-40ad-956c-69508a286f4c service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-unplugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-50128375-af64-4ce5-bc0e-16cbb599a59d req-292b5db7-01f6-40ad-956c-69508a286f4c service nova] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-50128375-af64-4ce5-bc0e-16cbb599a59d req-292b5db7-01f6-40ad-956c-69508a286f4c service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-50128375-af64-4ce5-bc0e-16cbb599a59d req-292b5db7-01f6-40ad-956c-69508a286f4c service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-50128375-af64-4ce5-bc0e-16cbb599a59d req-292b5db7-01f6-40ad-956c-69508a286f4c service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] No waiting events found dispatching network-vif-unplugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-50128375-af64-4ce5-bc0e-16cbb599a59d req-292b5db7-01f6-40ad-956c-69508a286f4c service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-unplugged-614067cd-fd42-4bc4-8707-742fde3c1b05 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:46 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Instance destroyed successfully.
Aug 16 12:35:46 user nova-compute[73520]: DEBUG nova.objects.instance [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'resources' on Instance uuid 52275f84-b38b-4351-befe-9052b1e02612 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1383144430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1383144430',id=39,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-6nnhz2wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:34:01Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=52275f84-b38b-4351-befe-9052b1e02612,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "614067cd-fd42-4bc4-8707-742fde3c1b05", "address": "fa:16:3e:34:5b:9f", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614067cd-fd", "ovs_interfaceid": "614067cd-fd42-4bc4-8707-742fde3c1b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:5b:9f,bridge_name='br-int',has_traffic_filtering=True,id=614067cd-fd42-4bc4-8707-742fde3c1b05,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614067cd-fd') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_vif [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:5b:9f,bridge_name='br-int',has_traffic_filtering=True,id=614067cd-fd42-4bc4-8707-742fde3c1b05,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614067cd-fd') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap614067cd-fd, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:46 user nova-compute[73520]: INFO os_vif [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:5b:9f,bridge_name='br-int',has_traffic_filtering=True,id=614067cd-fd42-4bc4-8707-742fde3c1b05,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614067cd-fd')
Aug 16 12:35:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuiMDjbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:35:46 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48183a1-9d4e-46f3-92e3-8d3be3054d69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46df3bc-91eb-4075-8490-e28aa55aacde]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:35:46 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:35:46 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:35:46 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:35:46 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:35:46 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:35:46 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:35:46 user nova-compute[73520]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 (non-flash)
Aug 16 12:35:46 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:35:46 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:35:46 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:35:46 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:35:46 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c4a3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585'): ({'sdd'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Removing single pathed devices sdd {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0cc294-ab15-498e-92c4-163ac45a118c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1644134-9021-4e6c-98bb-1e9dae3e2fd2]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flushing IO for device /dev/sdd {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[085ad4f5-cd07-4ebf-b187-5a2ef30df7ef]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f779404b-430e-4992-9d4b-be190df510ed]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] SCSI volumes sdd have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c4cdf4-cd93-4946-860e-d6aa1a982d40]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c162fb6-bf76-4e7b-80ce-d2e75b069146]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585, portal: 172.16.0.220,3260]
Aug 16 12:35:47 user nova-compute[73520]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585, portal: 172.16.0.220,3260] successful.
Aug 16 12:35:47 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c685011-7645-408a-97f7-cc9c4eb58585 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6db29bb-2892-4d45-affb-2301af912337]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:35:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:35:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:35:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] <== disconnect_volume: return (305ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:35:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:35:47 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Deleting instance files /opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612_del
Aug 16 12:35:47 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Deletion of /opt/stack/data/nova/instances/52275f84-b38b-4351-befe-9052b1e02612_del complete
Aug 16 12:35:47 user nova-compute[73520]: INFO nova.compute.manager [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 16 12:35:47 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:35:47 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:35:47 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 52275f84-b38b-4351-befe-9052b1e02612] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:35:47 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:35:47 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Took 0.49 seconds to deallocate network for instance.
Aug 16 12:35:47 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:35:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-5479bc0e-22c1-478f-b871-986240946411 req-8835d1f6-8bf0-4f60-8bb2-0314f27f7c04 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5479bc0e-22c1-478f-b871-986240946411 req-8835d1f6-8bf0-4f60-8bb2-0314f27f7c04 service nova] Acquiring lock "52275f84-b38b-4351-befe-9052b1e02612-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5479bc0e-22c1-478f-b871-986240946411 req-8835d1f6-8bf0-4f60-8bb2-0314f27f7c04 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5479bc0e-22c1-478f-b871-986240946411 req-8835d1f6-8bf0-4f60-8bb2-0314f27f7c04 service nova] Lock "52275f84-b38b-4351-befe-9052b1e02612-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-5479bc0e-22c1-478f-b871-986240946411 req-8835d1f6-8bf0-4f60-8bb2-0314f27f7c04 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] No waiting events found dispatching network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:35:48 user nova-compute[73520]: WARNING nova.compute.manager [req-5479bc0e-22c1-478f-b871-986240946411 req-8835d1f6-8bf0-4f60-8bb2-0314f27f7c04 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received unexpected event network-vif-plugged-614067cd-fd42-4bc4-8707-742fde3c1b05 for instance with vm_state active and task_state deleting.
Aug 16 12:35:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-5479bc0e-22c1-478f-b871-986240946411 req-8835d1f6-8bf0-4f60-8bb2-0314f27f7c04 service nova] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Received event network-vif-deleted-614067cd-fd42-4bc4-8707-742fde3c1b05 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:48 user nova-compute[73520]: INFO nova.compute.manager [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Took 0.77 seconds to detach 1 volumes for instance.
Aug 16 12:35:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:48 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:35:48 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:35:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:48 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Deleted allocations for instance 52275f84-b38b-4351-befe-9052b1e02612
Aug 16 12:35:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f8ab553-24cc-4df4-97bf-0abb9775f1e2 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "52275f84-b38b-4351-befe-9052b1e02612" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.982s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:35:51 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:35:51 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:35:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:52 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:35:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:35:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:35:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:35:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:35:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:35:55 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:35:55 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7625MB free_disk=25.052387237548828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d712e605-8ee2-4bd5-adce-61d0f284c835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 25b02048-2937-440a-9809-eceeb3558856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ce0355be-8b0e-4c8c-b052-10ac730fa6cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 26b0286b-9021-4859-88ac-760e7249a3d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 87762694-f7bc-44b4-a37b-7f9e11fdd627 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:35:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:35:56 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:35:56 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:35:56 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:35:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:35:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:35:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:35:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:35:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:35:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:35:58 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:35:58 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Updating instance_info_cache with network_info: [{"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:35:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:35:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:35:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-b72d36d5-eb85-487d-a600-db7f39dea235 req-737bfcd3-2c87-4b6b-8cb4-693f3f94dfc5 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-changed-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:35:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-b72d36d5-eb85-487d-a600-db7f39dea235 req-737bfcd3-2c87-4b6b-8cb4-693f3f94dfc5 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Refreshing instance network info cache due to event network-changed-53e90722-ef5f-49c8-b2b9-09ecaa2667d8. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:35:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b72d36d5-eb85-487d-a600-db7f39dea235 req-737bfcd3-2c87-4b6b-8cb4-693f3f94dfc5 service nova] Acquiring lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:35:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b72d36d5-eb85-487d-a600-db7f39dea235 req-737bfcd3-2c87-4b6b-8cb4-693f3f94dfc5 service nova] Acquired lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:35:59 user nova-compute[73520]: DEBUG nova.network.neutron [req-b72d36d5-eb85-487d-a600-db7f39dea235 req-737bfcd3-2c87-4b6b-8cb4-693f3f94dfc5 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Refreshing network info cache for port 53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "25b02048-2937-440a-9809-eceeb3558856" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:00 user nova-compute[73520]: INFO nova.compute.manager [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Detaching volume acfb26b9-0616-4c76-aa80-f02f03b8e281
Aug 16 12:36:00 user nova-compute[73520]: INFO nova.virt.block_device [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Attempting to driver detach volume acfb26b9-0616-4c76-aa80-f02f03b8e281 from mountpoint /dev/vdb
Aug 16 12:36:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Attempting to detach device vdb from instance 25b02048-2937-440a-9809-eceeb3558856 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:36:00 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:36:00 user nova-compute[73520]:   <source dev="/dev/sdf"/>
Aug 16 12:36:00 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:36:00 user nova-compute[73520]:   <serial>acfb26b9-0616-4c76-aa80-f02f03b8e281</serial>
Aug 16 12:36:00 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:36:00 user nova-compute[73520]: </disk>
Aug 16 12:36:00 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:36:00 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Successfully detached device vdb from instance 25b02048-2937-440a-9809-eceeb3558856 from the persistent domain config.
Aug 16 12:36:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25b02048-2937-440a-9809-eceeb3558856 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:36:00 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:36:00 user nova-compute[73520]:   <source dev="/dev/sdf"/>
Aug 16 12:36:00 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:36:00 user nova-compute[73520]:   <serial>acfb26b9-0616-4c76-aa80-f02f03b8e281</serial>
Aug 16 12:36:00 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:36:00 user nova-compute[73520]: </disk>
Aug 16 12:36:00 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG nova.network.neutron [req-b72d36d5-eb85-487d-a600-db7f39dea235 req-737bfcd3-2c87-4b6b-8cb4-693f3f94dfc5 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Updated VIF entry in instance network info cache for port 53e90722-ef5f-49c8-b2b9-09ecaa2667d8. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG nova.network.neutron [req-b72d36d5-eb85-487d-a600-db7f39dea235 req-737bfcd3-2c87-4b6b-8cb4-693f3f94dfc5 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Updating instance_info_cache with network_info: [{"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b72d36d5-eb85-487d-a600-db7f39dea235 req-737bfcd3-2c87-4b6b-8cb4-693f3f94dfc5 service nova] Releasing lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692189360.5238554, 25b02048-2937-440a-9809-eceeb3558856 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:36:00 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Successfully detached device vdb from instance 25b02048-2937-440a-9809-eceeb3558856 from the live domain config.
Aug 16 12:36:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KhfvNzxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:36:00 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef24dce6-2300-488b-9e7b-3363702f3f3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7f075b-3cfd-4685-b4d9-684c32b48a87]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:36:00 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:36:00 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:36:00 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:36:00 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:36:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:36:00 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:36:00 user nova-compute[73520]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 (non-flash)
Aug 16 12:36:00 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:36:00 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:36:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c692dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281'): ({'sdf'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Removing single pathed devices sdf {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ed6337-ff3a-4de3-b0ff-4157fb1b08df]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7422919b-0eff-4d89-bcd6-602e875675a4]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Flushing IO for device /dev/sdf {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adcbc73-e63d-4be5-b984-3d00baa9e602]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d15477-ef86-4d44-83e8-afb673b71697]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] SCSI volumes sdf have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd04156f-159f-4d87-895f-6b73869f362a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c1f187-8dd4-4320-a62b-82519bc9ab39]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281, portal: 172.16.0.220,3260]
Aug 16 12:36:00 user nova-compute[73520]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281, portal: 172.16.0.220,3260] successful.
Aug 16 12:36:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acfb26b9-0616-4c76-aa80-f02f03b8e281 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6c6d8a-3177-4360-b12f-4fe054c287bd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] <== disconnect_volume: return (304ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:36:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:36:01 user nova-compute[73520]: DEBUG nova.compute.manager [req-51e55b0e-4118-413c-b05e-22a9ad7079c4 req-70b96a93-f24f-4b75-8340-c621b68c05a9 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-changed-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:01 user nova-compute[73520]: DEBUG nova.compute.manager [req-51e55b0e-4118-413c-b05e-22a9ad7079c4 req-70b96a93-f24f-4b75-8340-c621b68c05a9 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Refreshing instance network info cache due to event network-changed-53e90722-ef5f-49c8-b2b9-09ecaa2667d8. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:36:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-51e55b0e-4118-413c-b05e-22a9ad7079c4 req-70b96a93-f24f-4b75-8340-c621b68c05a9 service nova] Acquiring lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:36:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-51e55b0e-4118-413c-b05e-22a9ad7079c4 req-70b96a93-f24f-4b75-8340-c621b68c05a9 service nova] Acquired lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:36:01 user nova-compute[73520]: DEBUG nova.network.neutron [req-51e55b0e-4118-413c-b05e-22a9ad7079c4 req-70b96a93-f24f-4b75-8340-c621b68c05a9 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Refreshing network info cache for port 53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:36:01 user nova-compute[73520]: DEBUG nova.objects.instance [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'flavor' on Instance uuid 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:36:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1a42e5a0-4f11-4f5a-903d-26aba5f832aa tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "25b02048-2937-440a-9809-eceeb3558856" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.672s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:01 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189346.7243865, 52275f84-b38b-4351-befe-9052b1e02612 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:36:01 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 52275f84-b38b-4351-befe-9052b1e02612] VM Stopped (Lifecycle Event)
Aug 16 12:36:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-db8a4638-6b06-4af6-a2f4-b4fd325c9310 None None] [instance: 52275f84-b38b-4351-befe-9052b1e02612] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:36:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:36:02 user nova-compute[73520]: DEBUG nova.network.neutron [req-51e55b0e-4118-413c-b05e-22a9ad7079c4 req-70b96a93-f24f-4b75-8340-c621b68c05a9 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Updated VIF entry in instance network info cache for port 53e90722-ef5f-49c8-b2b9-09ecaa2667d8. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:36:02 user nova-compute[73520]: DEBUG nova.network.neutron [req-51e55b0e-4118-413c-b05e-22a9ad7079c4 req-70b96a93-f24f-4b75-8340-c621b68c05a9 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Updating instance_info_cache with network_info: [{"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:36:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-51e55b0e-4118-413c-b05e-22a9ad7079c4 req-70b96a93-f24f-4b75-8340-c621b68c05a9 service nova] Releasing lock "refresh_cache-25b02048-2937-440a-9809-eceeb3558856" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:36:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:36:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:23 user nova-compute[73520]: DEBUG nova.compute.manager [req-73f55787-b70d-4259-8d7b-7da67532db8e req-ef40944e-6a93-43c4-961e-3eaa6d1d373c service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-changed-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:23 user nova-compute[73520]: DEBUG nova.compute.manager [req-73f55787-b70d-4259-8d7b-7da67532db8e req-ef40944e-6a93-43c4-961e-3eaa6d1d373c service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Refreshing instance network info cache due to event network-changed-4f15c60a-7230-4011-9f93-15cf877d4bb9. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:36:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-73f55787-b70d-4259-8d7b-7da67532db8e req-ef40944e-6a93-43c4-961e-3eaa6d1d373c service nova] Acquiring lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:36:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-73f55787-b70d-4259-8d7b-7da67532db8e req-ef40944e-6a93-43c4-961e-3eaa6d1d373c service nova] Acquired lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:36:23 user nova-compute[73520]: DEBUG nova.network.neutron [req-73f55787-b70d-4259-8d7b-7da67532db8e req-ef40944e-6a93-43c4-961e-3eaa6d1d373c service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Refreshing network info cache for port 4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:36:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:23 user nova-compute[73520]: INFO nova.compute.manager [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Shelve offloading
Aug 16 12:36:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-f8366a91-6d5e-4117-bffd-ae8c1999c8c0 req-6b725202-c9fc-411e-8ef2-9d2e07b9776c service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-vif-unplugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f8366a91-6d5e-4117-bffd-ae8c1999c8c0 req-6b725202-c9fc-411e-8ef2-9d2e07b9776c service nova] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f8366a91-6d5e-4117-bffd-ae8c1999c8c0 req-6b725202-c9fc-411e-8ef2-9d2e07b9776c service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f8366a91-6d5e-4117-bffd-ae8c1999c8c0 req-6b725202-c9fc-411e-8ef2-9d2e07b9776c service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:24 user nova-compute[73520]: DEBUG nova.compute.manager [req-f8366a91-6d5e-4117-bffd-ae8c1999c8c0 req-6b725202-c9fc-411e-8ef2-9d2e07b9776c service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] No waiting events found dispatching network-vif-unplugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:36:24 user nova-compute[73520]: WARNING nova.compute.manager [req-f8366a91-6d5e-4117-bffd-ae8c1999c8c0 req-6b725202-c9fc-411e-8ef2-9d2e07b9776c service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received unexpected event network-vif-unplugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 for instance with vm_state active and task_state shelving.
Aug 16 12:36:24 user nova-compute[73520]: DEBUG nova.network.neutron [req-73f55787-b70d-4259-8d7b-7da67532db8e req-ef40944e-6a93-43c4-961e-3eaa6d1d373c service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updated VIF entry in instance network info cache for port 4f15c60a-7230-4011-9f93-15cf877d4bb9. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:36:24 user nova-compute[73520]: DEBUG nova.network.neutron [req-73f55787-b70d-4259-8d7b-7da67532db8e req-ef40944e-6a93-43c4-961e-3eaa6d1d373c service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updating instance_info_cache with network_info: [{"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:36:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-73f55787-b70d-4259-8d7b-7da67532db8e req-ef40944e-6a93-43c4-961e-3eaa6d1d373c service nova] Releasing lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:36:24 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Instance destroyed successfully.
Aug 16 12:36:24 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:36:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:36:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquired lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:36:24 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:36:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.network.neutron [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updating instance_info_cache with network_info: [{"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:36:25 user nova-compute[73520]: INFO nova.compute.manager [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Terminating instance
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Releasing lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.compute.manager [req-fd1a83e6-dbfa-4650-b41e-9fdf42e83fb3 req-27dd3702-de8c-4e33-850e-951df5ec433d service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Received event network-changed-dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.compute.manager [req-fd1a83e6-dbfa-4650-b41e-9fdf42e83fb3 req-27dd3702-de8c-4e33-850e-951df5ec433d service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Refreshing instance network info cache due to event network-changed-dc85c0d3-f29f-4255-84ed-38c36ebdb094. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-fd1a83e6-dbfa-4650-b41e-9fdf42e83fb3 req-27dd3702-de8c-4e33-850e-951df5ec433d service nova] Acquiring lock "refresh_cache-ce0355be-8b0e-4c8c-b052-10ac730fa6cf" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-fd1a83e6-dbfa-4650-b41e-9fdf42e83fb3 req-27dd3702-de8c-4e33-850e-951df5ec433d service nova] Acquired lock "refresh_cache-ce0355be-8b0e-4c8c-b052-10ac730fa6cf" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.network.neutron [req-fd1a83e6-dbfa-4650-b41e-9fdf42e83fb3 req-27dd3702-de8c-4e33-850e-951df5ec433d service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Refreshing network info cache for port dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:36:25 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Instance destroyed successfully.
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.objects.instance [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lazy-loading 'resources' on Instance uuid 87762694-f7bc-44b4-a37b-7f9e11fdd627 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:36:25 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Instance destroyed successfully.
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.objects.instance [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lazy-loading 'resources' on Instance uuid ce0355be-8b0e-4c8c-b052-10ac730fa6cf {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.compute.manager [req-7d381b39-364a-42e4-a24c-b04956a0d34d req-ea911228-cc79-491c-8802-35d305820e8c service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-changed-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.compute.manager [req-7d381b39-364a-42e4-a24c-b04956a0d34d req-ea911228-cc79-491c-8802-35d305820e8c service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Refreshing instance network info cache due to event network-changed-4f15c60a-7230-4011-9f93-15cf877d4bb9. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7d381b39-364a-42e4-a24c-b04956a0d34d req-ea911228-cc79-491c-8802-35d305820e8c service nova] Acquiring lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7d381b39-364a-42e4-a24c-b04956a0d34d req-ea911228-cc79-491c-8802-35d305820e8c service nova] Acquired lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.network.neutron [req-7d381b39-364a-42e4-a24c-b04956a0d34d req-ea911228-cc79-491c-8802-35d305820e8c service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Refreshing network info cache for port 4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1762968804',display_name='tempest-TestShelveInstance-server-1762968804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1762968804',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0Yb5/yDtg/+xo5Xx2Aj8NIMdu6T6UP+UvyUgQRFiFrHQrxuwRb4TYEqIrdfN8knygXFvaDYnN6hJcknWDLd/V/82hafp7vrTaSbn8yS/kvOhfMvo4bViuQawj8E1al9w==',key_name='tempest-TestShelveInstance-1599693803',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:34:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af7f1193dcd3415ca0e442cf073c7d92',ramdisk_id='',reservation_id='r-zrcwdju7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1971700305',owner_user_name='tempest-TestShelveInstance-1971700305-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:34:49Z,user_data=None,user_id='8dad9f2c3d7141c884f25d5e9a36f240',uuid=87762694-f7bc-44b4-a37b-7f9e11fdd627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Converting VIF {"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG os_vif [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1596451022',display_name='tempest-TestVolumeBootPattern-server-1596451022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1596451022',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJr/o6vrVZnxmYhfYixlxoifuhCtvsj5vKkg3ZAc0JSOeGoo3PmY57Yx5t3KGcWwXVP9aD5zqccktnbo7190qT8/kMlT5jQNhZVEjx4vkSe9H5//tD72sKPKPHQkEbRmQ==',key_name='tempest-TestVolumeBootPattern-586845281',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:31:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a693cd27934644be8e64731417c66783',ramdisk_id='',reservation_id='r-5fd3cnsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-496055159',owner_user_name='tempest-TestVolumeBootPattern-496055159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:31:16Z,user_data=None,user_id='17ed1823b0de433ab523470e235fdd72',uuid=ce0355be-8b0e-4c8c-b052-10ac730fa6cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "address": "fa:16:3e:c1:d5:79", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc85c0d3-f2", "ovs_interfaceid": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converting VIF {"id": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "address": "fa:16:3e:c1:d5:79", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc85c0d3-f2", "ovs_interfaceid": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:d5:79,bridge_name='br-int',has_traffic_filtering=True,id=dc85c0d3-f29f-4255-84ed-38c36ebdb094,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc85c0d3-f2') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG os_vif [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:d5:79,bridge_name='br-int',has_traffic_filtering=True,id=dc85c0d3-f29f-4255-84ed-38c36ebdb094,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc85c0d3-f2') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f15c60a-72, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc85c0d3-f2, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:36:25 user nova-compute[73520]: INFO os_vif [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72')
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvXdJlwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:36:25 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:36:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:25 user nova-compute[73520]: INFO os_vif [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:d5:79,bridge_name='br-int',has_traffic_filtering=True,id=dc85c0d3-f29f-4255-84ed-38c36ebdb094,network=Network(ecc52c1b-14c4-4559-9a23-99979e5edfed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc85c0d3-f2')
Aug 16 12:36:25 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WqXJxpaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:36:25 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:36:25 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[284e344e-3ab3-4b12-90d5-507b143fbc3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:25 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb8db29-a3b5-42d4-b7d7-5f53447dd305]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:36:26 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:36:26 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:36:26 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:36:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:36:26 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:36:26 user nova-compute[73520]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:36:26 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:36:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c7d5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679'): ({'sde'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Removing single pathed devices sde {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eded1549-5cbb-4d49-a857-b9ac67e6f25c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efd9e15-efbb-4483-bb5b-df2bb951cd91]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Flushing IO for device /dev/sde {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.compute.manager [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.compute.manager [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] No waiting events found dispatching network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:36:26 user nova-compute[73520]: WARNING nova.compute.manager [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received unexpected event network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 for instance with vm_state active and task_state shelving.
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.compute.manager [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Received event network-vif-unplugged-dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] Acquiring lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.compute.manager [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] No waiting events found dispatching network-vif-unplugged-dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.compute.manager [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Received event network-vif-unplugged-dc85c0d3-f29f-4255-84ed-38c36ebdb094 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.compute.manager [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Received event network-vif-plugged-dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] Acquiring lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.compute.manager [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] No waiting events found dispatching network-vif-plugged-dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:36:26 user nova-compute[73520]: WARNING nova.compute.manager [req-bc9665ee-f3f3-4f47-920b-66e566fda68f req-6cab992c-9112-4494-8607-0c1bb87d59ed service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Received unexpected event network-vif-plugged-dc85c0d3-f29f-4255-84ed-38c36ebdb094 for instance with vm_state active and task_state deleting.
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b082f3c-61da-4e32-a4a6-09f7f9dccdce]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8469bcd7-0686-4e5b-8b68-b00c32e5dc15]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] SCSI volumes sde have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a392b3b-f3f9-488a-8a71-70e06b567a59]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.network.neutron [req-fd1a83e6-dbfa-4650-b41e-9fdf42e83fb3 req-27dd3702-de8c-4e33-850e-951df5ec433d service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Updated VIF entry in instance network info cache for port dc85c0d3-f29f-4255-84ed-38c36ebdb094. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.network.neutron [req-fd1a83e6-dbfa-4650-b41e-9fdf42e83fb3 req-27dd3702-de8c-4e33-850e-951df5ec433d service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Updating instance_info_cache with network_info: [{"id": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "address": "fa:16:3e:c1:d5:79", "network": {"id": "ecc52c1b-14c4-4559-9a23-99979e5edfed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1790172200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a693cd27934644be8e64731417c66783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc85c0d3-f2", "ovs_interfaceid": "dc85c0d3-f29f-4255-84ed-38c36ebdb094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-fd1a83e6-dbfa-4650-b41e-9fdf42e83fb3 req-27dd3702-de8c-4e33-850e-951df5ec433d service nova] Releasing lock "refresh_cache-ce0355be-8b0e-4c8c-b052-10ac730fa6cf" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed65bca-020f-4b12-bdaa-7a8abfc777d0]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260]
Aug 16 12:36:26 user nova-compute[73520]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260] successful.
Aug 16 12:36:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa74d9d-ab16-4cb8-a643-dab7c71abaf0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] <== disconnect_volume: return (369ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:36:26 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Deleting instance files /opt/stack/data/nova/instances/87762694-f7bc-44b4-a37b-7f9e11fdd627_del
Aug 16 12:36:26 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Deletion of /opt/stack/data/nova/instances/87762694-f7bc-44b4-a37b-7f9e11fdd627_del complete
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.356s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cae83d-ed28-49c5-b958-a89fc0645b49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bd264e-57da-42eb-970a-9af1a31cbccc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:36:26 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:36:26 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:36:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:36:26 user nova-compute[73520]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d (non-flash)
Aug 16 12:36:26 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:36:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa76c0767a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba25d61-5bcb-40b1-8309-a756e9725c26]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a0d5a3-1ddf-4c49-a6a0-16000e5d7a1c]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f0390f-1fbf-40ae-ace4-253686248019]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[37789713-0927-408e-b165-c753a10c61f6]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.network.neutron [req-7d381b39-364a-42e4-a24c-b04956a0d34d req-ea911228-cc79-491c-8802-35d305820e8c service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updated VIF entry in instance network info cache for port 4f15c60a-7230-4011-9f93-15cf877d4bb9. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.network.neutron [req-7d381b39-364a-42e4-a24c-b04956a0d34d req-ea911228-cc79-491c-8802-35d305820e8c service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updating instance_info_cache with network_info: [{"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": null, "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4f15c60a-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff13429-a34f-4571-b386-72cb0dddbe82]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7d381b39-364a-42e4-a24c-b04956a0d34d req-ea911228-cc79-491c-8802-35d305820e8c service nova] Releasing lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f5b3e0-3781-43c1-81e2-a5dd10edd90b]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260]
Aug 16 12:36:26 user nova-compute[73520]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d, portal: 172.16.0.220,3260] successful.
Aug 16 12:36:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:302ee37b-8d89-4d04-b0df-72d5e8b6d86d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3d479f-9d91-4a56-9d38-609fa101e972]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] <== disconnect_volume: return (676ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:36:26 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Deleting instance files /opt/stack/data/nova/instances/ce0355be-8b0e-4c8c-b052-10ac730fa6cf_del
Aug 16 12:36:26 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Deletion of /opt/stack/data/nova/instances/ce0355be-8b0e-4c8c-b052-10ac730fa6cf_del complete
Aug 16 12:36:26 user nova-compute[73520]: INFO nova.compute.manager [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Took 1.68 seconds to destroy the instance on the hypervisor.
Aug 16 12:36:26 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:36:26 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:36:27 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:36:27 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Took 0.65 seconds to deallocate network for instance.
Aug 16 12:36:27 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Deleted allocations for instance 87762694-f7bc-44b4-a37b-7f9e11fdd627
Aug 16 12:36:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:27 user nova-compute[73520]: DEBUG nova.objects.instance [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lazy-loading 'numa_topology' on Instance uuid 87762694-f7bc-44b4-a37b-7f9e11fdd627 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:36:27 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:36:27 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:36:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-4f26c143-3242-4f1f-b57d-c4dedc76529c tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.115s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-2ba10b9c-3028-410d-b67a-c2b8524b1b91 req-3bc80ae1-57ba-4db4-b0ff-555cd93f9037 service nova] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Received event network-vif-deleted-dc85c0d3-f29f-4255-84ed-38c36ebdb094 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:28 user nova-compute[73520]: INFO nova.compute.manager [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Took 0.84 seconds to detach 1 volumes for instance.
Aug 16 12:36:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:28 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:36:28 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:36:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:28 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Deleted allocations for instance ce0355be-8b0e-4c8c-b052-10ac730fa6cf
Aug 16 12:36:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-928d6820-044f-4bcb-a569-076ec915b4ac tempest-TestVolumeBootPattern-496055159 tempest-TestVolumeBootPattern-496055159-project-member] Lock "ce0355be-8b0e-4c8c-b052-10ac730fa6cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.794s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "d712e605-8ee2-4bd5-adce-61d0f284c835" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:36 user nova-compute[73520]: INFO nova.compute.manager [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Terminating instance
Aug 16 12:36:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:36:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG nova.compute.manager [req-100f68b1-9d67-4378-8e45-7f0cc7afbb65 req-b28f9263-fe1c-41b0-86bb-f2e556e18b7b service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received event network-vif-unplugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-100f68b1-9d67-4378-8e45-7f0cc7afbb65 req-b28f9263-fe1c-41b0-86bb-f2e556e18b7b service nova] Acquiring lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-100f68b1-9d67-4378-8e45-7f0cc7afbb65 req-b28f9263-fe1c-41b0-86bb-f2e556e18b7b service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-100f68b1-9d67-4378-8e45-7f0cc7afbb65 req-b28f9263-fe1c-41b0-86bb-f2e556e18b7b service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG nova.compute.manager [req-100f68b1-9d67-4378-8e45-7f0cc7afbb65 req-b28f9263-fe1c-41b0-86bb-f2e556e18b7b service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] No waiting events found dispatching network-vif-unplugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG nova.compute.manager [req-100f68b1-9d67-4378-8e45-7f0cc7afbb65 req-b28f9263-fe1c-41b0-86bb-f2e556e18b7b service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received event network-vif-unplugged-131d0164-5b2f-4e74-96c4-36ff11809851 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Instance destroyed successfully.
Aug 16 12:36:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'resources' on Instance uuid d712e605-8ee2-4bd5-adce-61d0f284c835 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:27:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-732553761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-732553761',id=35,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:27:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-bkorysu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:29:11Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=d712e605-8ee2-4bd5-adce-61d0f284c835,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "131d0164-5b2f-4e74-96c4-36ff11809851", "address": "fa:16:3e:57:9f:46", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d0164-5b", "ovs_interfaceid": "131d0164-5b2f-4e74-96c4-36ff11809851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "131d0164-5b2f-4e74-96c4-36ff11809851", "address": "fa:16:3e:57:9f:46", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d0164-5b", "ovs_interfaceid": "131d0164-5b2f-4e74-96c4-36ff11809851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:9f:46,bridge_name='br-int',has_traffic_filtering=True,id=131d0164-5b2f-4e74-96c4-36ff11809851,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d0164-5b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG os_vif [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9f:46,bridge_name='br-int',has_traffic_filtering=True,id=131d0164-5b2f-4e74-96c4-36ff11809851,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d0164-5b') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap131d0164-5b, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: INFO os_vif [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9f:46,bridge_name='br-int',has_traffic_filtering=True,id=131d0164-5b2f-4e74-96c4-36ff11809851,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d0164-5b')
Aug 16 12:36:37 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Deleting instance files /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835_del
Aug 16 12:36:37 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Deletion of /opt/stack/data/nova/instances/d712e605-8ee2-4bd5-adce-61d0f284c835_del complete
Aug 16 12:36:37 user nova-compute[73520]: INFO nova.compute.manager [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Took 0.76 seconds to destroy the instance on the hypervisor.
Aug 16 12:36:37 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:38 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:36:38 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Took 0.72 seconds to deallocate network for instance.
Aug 16 12:36:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-d05c2b37-a938-4577-af0f-80c7b593da6d req-7bcb3eae-e71f-4e45-bf79-d9bfad9109d0 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received event network-vif-deleted-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:38 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:36:38 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:36:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:38 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Deleted allocations for instance d712e605-8ee2-4bd5-adce-61d0f284c835
Aug 16 12:36:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-65cd76a9-47a4-4a33-bf4d-db0d78d6ee61 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.939s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received event network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Acquiring lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] No waiting events found dispatching network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:36:39 user nova-compute[73520]: WARNING nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received unexpected event network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 for instance with vm_state deleted and task_state None.
Aug 16 12:36:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received event network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Acquiring lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] No waiting events found dispatching network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:36:39 user nova-compute[73520]: WARNING nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received unexpected event network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 for instance with vm_state deleted and task_state None.
Aug 16 12:36:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received event network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Acquiring lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] No waiting events found dispatching network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:36:39 user nova-compute[73520]: WARNING nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received unexpected event network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 for instance with vm_state deleted and task_state None.
Aug 16 12:36:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received event network-vif-unplugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Acquiring lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] No waiting events found dispatching network-vif-unplugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:36:39 user nova-compute[73520]: WARNING nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received unexpected event network-vif-unplugged-131d0164-5b2f-4e74-96c4-36ff11809851 for instance with vm_state deleted and task_state None.
Aug 16 12:36:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received event network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Acquiring lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] Lock "d712e605-8ee2-4bd5-adce-61d0f284c835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] No waiting events found dispatching network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:36:39 user nova-compute[73520]: WARNING nova.compute.manager [req-570fcfee-b232-40a8-b51c-e775e4aff683 req-37f7346d-fd3a-4352-b045-2122dd103617 service nova] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Received unexpected event network-vif-plugged-131d0164-5b2f-4e74-96c4-36ff11809851 for instance with vm_state deleted and task_state None.
Aug 16 12:36:39 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189384.4977653, 87762694-f7bc-44b4-a37b-7f9e11fdd627 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:36:39 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] VM Stopped (Lifecycle Event)
Aug 16 12:36:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-1a7d2fa2-87f7-421a-928c-ec4cab68d08c None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:36:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:40 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189385.8588803, ce0355be-8b0e-4c8c-b052-10ac730fa6cf => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:36:40 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] VM Stopped (Lifecycle Event)
Aug 16 12:36:40 user nova-compute[73520]: DEBUG nova.compute.manager [None req-87612bc3-4ad2-4d68-83b7-657e9d8bf937 None None] [instance: ce0355be-8b0e-4c8c-b052-10ac730fa6cf] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:36:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:36:42 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:36:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:36:43 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:36:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:36:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:36:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:36:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:36:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "25b02048-2937-440a-9809-eceeb3558856" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "25b02048-2937-440a-9809-eceeb3558856-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "25b02048-2937-440a-9809-eceeb3558856-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:50 user nova-compute[73520]: INFO nova.compute.manager [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Terminating instance
Aug 16 12:36:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:36:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d47e982-c917-480a-b8ed-140d0f3c57dc req-f687bcee-fb23-45c4-a28d-18632a6d94bd service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-unplugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d47e982-c917-480a-b8ed-140d0f3c57dc req-f687bcee-fb23-45c4-a28d-18632a6d94bd service nova] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d47e982-c917-480a-b8ed-140d0f3c57dc req-f687bcee-fb23-45c4-a28d-18632a6d94bd service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d47e982-c917-480a-b8ed-140d0f3c57dc req-f687bcee-fb23-45c4-a28d-18632a6d94bd service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d47e982-c917-480a-b8ed-140d0f3c57dc req-f687bcee-fb23-45c4-a28d-18632a6d94bd service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] No waiting events found dispatching network-vif-unplugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:36:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d47e982-c917-480a-b8ed-140d0f3c57dc req-f687bcee-fb23-45c4-a28d-18632a6d94bd service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-unplugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:51 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 25b02048-2937-440a-9809-eceeb3558856] Instance destroyed successfully.
Aug 16 12:36:51 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'resources' on Instance uuid 25b02048-2937-440a-9809-eceeb3558856 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1961434269',display_name='tempest-ServerRescueNegativeTestJSON-server-1961434269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1961434269',id=38,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/RNXMMAE6Nph8fr40EWI8DA2vqJl1a7Tx5xgfI37ZS3iKYbKFVFDMfz8BRbL3rjE3RFbrWS1JU5JZI5jkyrlHh+n7SlBJyNgsnXpezEuggqqGA9pismjrTTMnP74Mvdw==',key_name='tempest-keypair-1410904948',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:32:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930fb7964e2942c88c3416be172c6884',ramdisk_id='',reservation_id='r-27j4rxm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-863509458',owner_user_name='tempest-ServerRescueNegativeTestJSON-863509458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d351d0adad3463ebb2e6917a5f91920',uuid=25b02048-2937-440a-9809-eceeb3558856,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converting VIF {"id": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "address": "fa:16:3e:c2:11:90", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e90722-ef", "ovs_interfaceid": "53e90722-ef5f-49c8-b2b9-09ecaa2667d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:11:90,bridge_name='br-int',has_traffic_filtering=True,id=53e90722-ef5f-49c8-b2b9-09ecaa2667d8,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e90722-ef') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG os_vif [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:11:90,bridge_name='br-int',has_traffic_filtering=True,id=53e90722-ef5f-49c8-b2b9-09ecaa2667d8,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e90722-ef') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53e90722-ef, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:51 user nova-compute[73520]: INFO os_vif [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:11:90,bridge_name='br-int',has_traffic_filtering=True,id=53e90722-ef5f-49c8-b2b9-09ecaa2667d8,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e90722-ef')
Aug 16 12:36:51 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Deleting instance files /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856_del
Aug 16 12:36:51 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Deletion of /opt/stack/data/nova/instances/25b02048-2937-440a-9809-eceeb3558856_del complete
Aug 16 12:36:51 user nova-compute[73520]: INFO nova.compute.manager [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 25b02048-2937-440a-9809-eceeb3558856] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 16 12:36:51 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 25b02048-2937-440a-9809-eceeb3558856] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 25b02048-2937-440a-9809-eceeb3558856] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:51 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189397.3890324, d712e605-8ee2-4bd5-adce-61d0f284c835 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:36:52 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] VM Stopped (Lifecycle Event)
Aug 16 12:36:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-381c523a-4409-4f1f-abb3-8296d69f3dad None None] [instance: d712e605-8ee2-4bd5-adce-61d0f284c835] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 25b02048-2937-440a-9809-eceeb3558856] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:36:52 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 25b02048-2937-440a-9809-eceeb3558856] Took 0.97 seconds to deallocate network for instance.
Aug 16 12:36:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:52 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Deleted allocations for instance 25b02048-2937-440a-9809-eceeb3558856
Aug 16 12:36:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG nova.compute.manager [req-17fbd2eb-61a3-471f-bf9b-ae7e62693159 req-ef883fa9-eac4-406d-b3ae-a029f74fdf85 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-17fbd2eb-61a3-471f-bf9b-ae7e62693159 req-ef883fa9-eac4-406d-b3ae-a029f74fdf85 service nova] Acquiring lock "25b02048-2937-440a-9809-eceeb3558856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-17fbd2eb-61a3-471f-bf9b-ae7e62693159 req-ef883fa9-eac4-406d-b3ae-a029f74fdf85 service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-17fbd2eb-61a3-471f-bf9b-ae7e62693159 req-ef883fa9-eac4-406d-b3ae-a029f74fdf85 service nova] Lock "25b02048-2937-440a-9809-eceeb3558856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG nova.compute.manager [req-17fbd2eb-61a3-471f-bf9b-ae7e62693159 req-ef883fa9-eac4-406d-b3ae-a029f74fdf85 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] No waiting events found dispatching network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:36:53 user nova-compute[73520]: WARNING nova.compute.manager [req-17fbd2eb-61a3-471f-bf9b-ae7e62693159 req-ef883fa9-eac4-406d-b3ae-a029f74fdf85 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received unexpected event network-vif-plugged-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 for instance with vm_state deleted and task_state None.
Aug 16 12:36:53 user nova-compute[73520]: DEBUG nova.compute.manager [req-17fbd2eb-61a3-471f-bf9b-ae7e62693159 req-ef883fa9-eac4-406d-b3ae-a029f74fdf85 service nova] [instance: 25b02048-2937-440a-9809-eceeb3558856] Received event network-vif-deleted-53e90722-ef5f-49c8-b2b9-09ecaa2667d8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b13a1832-0b96-435d-a47f-b2f0dfdcbfd1 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "25b02048-2937-440a-9809-eceeb3558856" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.394s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:53 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:54 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:36:54 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:36:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8204MB free_disk=25.195266723632812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 26b0286b-9021-4859-88ac-760e7249a3d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:36:54 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:36:55 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:36:55 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:36:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:36:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.334s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:36:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:36:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:36:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 12:36:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-60465ad7-b050-42a6-b437-6deae9d88dd3 req-e36cda5b-83f1-4f04-9347-88a59533186a service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Received event network-changed-b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-60465ad7-b050-42a6-b437-6deae9d88dd3 req-e36cda5b-83f1-4f04-9347-88a59533186a service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Refreshing instance network info cache due to event network-changed-b24cb0a1-1a5f-4285-a039-d96713541f95. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-60465ad7-b050-42a6-b437-6deae9d88dd3 req-e36cda5b-83f1-4f04-9347-88a59533186a service nova] Acquiring lock "refresh_cache-1e3d30e6-7800-4dd9-88ae-6abe48c980e5" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-60465ad7-b050-42a6-b437-6deae9d88dd3 req-e36cda5b-83f1-4f04-9347-88a59533186a service nova] Acquired lock "refresh_cache-1e3d30e6-7800-4dd9-88ae-6abe48c980e5" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG nova.network.neutron [req-60465ad7-b050-42a6-b437-6deae9d88dd3 req-e36cda5b-83f1-4f04-9347-88a59533186a service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Refreshing network info cache for port b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG nova.objects.instance [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lazy-loading 'flavor' on Instance uuid 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:36:59 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Ignoring supplied device name: /dev/vdb
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:36:59 user nova-compute[73520]: INFO nova.compute.manager [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Attaching volume d8d131ed-47ca-46fe-911b-1ab629c57178 to /dev/vdb
Aug 16 12:36:59 user nova-compute[73520]: DEBUG os_brick.utils [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f4924d-9274-486c-9223-cb3c62379972]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d4c68d-59c1-492c-898a-163b6a97b7c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73392d4-f286-44a0-9778-3842bab28d48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9117068-a603-42a0-a0f3-1a260b3d5e0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG nova.network.neutron [req-60465ad7-b050-42a6-b437-6deae9d88dd3 req-e36cda5b-83f1-4f04-9347-88a59533186a service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Updated VIF entry in instance network info cache for port b24cb0a1-1a5f-4285-a039-d96713541f95. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG nova.network.neutron [req-60465ad7-b050-42a6-b437-6deae9d88dd3 req-e36cda5b-83f1-4f04-9347-88a59533186a service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Updating instance_info_cache with network_info: [{"id": "b24cb0a1-1a5f-4285-a039-d96713541f95", "address": "fa:16:3e:63:af:75", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24cb0a1-1a", "ovs_interfaceid": "b24cb0a1-1a5f-4285-a039-d96713541f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:36:59 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:36:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5d69e6-a4a9-45c7-8563-8707293a9a89]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG os_brick.utils [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:36:59 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Updating existing volume attachment record: c7149116-35c1-4bc8-ab1c-ec361f974c3b {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:37:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-60465ad7-b050-42a6-b437-6deae9d88dd3 req-e36cda5b-83f1-4f04-9347-88a59533186a service nova] Releasing lock "refresh_cache-1e3d30e6-7800-4dd9-88ae-6abe48c980e5" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:37:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:06 user nova-compute[73520]: DEBUG nova.objects.instance [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'flavor' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:37:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquired lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:37:06 user nova-compute[73520]: DEBUG nova.network.neutron [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:37:06 user nova-compute[73520]: DEBUG nova.objects.instance [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'info_cache' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:06 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189411.3950822, 25b02048-2937-440a-9809-eceeb3558856 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:37:06 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 25b02048-2937-440a-9809-eceeb3558856] VM Stopped (Lifecycle Event)
Aug 16 12:37:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f90cda24-a6ef-4ad8-9de8-19fd40feee74 None None] [instance: 25b02048-2937-440a-9809-eceeb3558856] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:37:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updating instance_info_cache with network_info: [{"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Releasing lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:37:07 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Instance destroyed successfully.
Aug 16 12:37:07 user nova-compute[73520]: DEBUG nova.objects.instance [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'resources' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1747553426',display_name='tempest-AttachVolumeTestJSON-server-1747553426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1747553426',id=42,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF2K5lPCqq45wlqWBJxOjnJMaqjiorbGycI/+zIIrQyDX2lqhtiNH0sOEH1miqoWIiFDFfI+JbhEvZIwSQ6ThAdNXntyvNLGxVlW0nvg7ZrlFK5UVMdROmd3/SoB5yrFw==',key_name='tempest-keypair-1911074579',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='446e9796da1f4303bb7d628fa8c8c3c3',ramdisk_id='',reservation_id='r-0o6wl00i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1174912644',owner_user_name='tempest-AttachVolumeTestJSON-1174912644-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9ef4b48f36408eba035f0d7e277dcb',uuid=26b0286b-9021-4859-88ac-760e7249a3d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converting VIF {"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_vif [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e7cef18-ea, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:37:07 user nova-compute[73520]: INFO os_vif [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea')
Aug 16 12:37:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJBPsaTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:37:07 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33da43c-5140-4cf2-9376-581ede3263b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69f1750-1294-4c55-893d-b21f9abcba92]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:37:07 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:37:07 user nova-compute[73520]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:07 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c497370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057'): ({'sdg'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Removing single pathed devices sdg {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9006d06f-66d0-4fce-bd57-aa2ad79e9d05]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4ebd83-b9a1-48eb-b82b-810a506d6171]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Flushing IO for device /dev/sdg {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e1f78d-620c-40ec-9023-321c0140d35e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d24370c-bfe6-414b-b0b2-7540d0694221]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] SCSI volumes sdg have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cc02fd-4f52-423a-b74d-2c62e6193bac]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7926b5fc-900d-41b0-a18b-9c09846d9954]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260]
Aug 16 12:37:08 user nova-compute[73520]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260] successful.
Aug 16 12:37:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc6ac29-7c66-46d5-83ba-49cce797cde5]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] <== disconnect_volume: return (287ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Start _get_guest_xml network_info=[{"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJBPsaTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '26b0286b-9021-4859-88ac-760e7249a3d2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f400539b-2944-4af4-b254-9ec43bfd6057', 'serial': 'f400539b-2944-4af4-b254-9ec43bfd6057'}, 'attachment_id': 'a68f86c3-1259-4613-ae64-f2079b02b3e6', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.objects.instance [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'numa_topology' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:08 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:37:08 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.objects.instance [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'vcpu_model' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJBPsaTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:37:08 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:37:08 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:37:08 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a54ff82-f838-4ec9-941a-3f1b352a7dba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:37:08 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d2d4ea-ba20-48a0-a4ff-7b61d51736fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057] added
Aug 16 12:37:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c59b2f3-44fd-4f8d-baf1-def5dd690892]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae7afce-8ff3-4484-a092-5676489c13b3]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJBPsaTX {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJBPsaTX" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[904c206d-ebf7-4a95-a6cd-fa2e63a0088c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qJBPsaTX'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d33d94-560a-4f94-aecf-c7d4225c3f62]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fc6272-e927-480f-833d-9d5a8c74edf2]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:37:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:37:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae4eae-3d73-4d67-9970-5c832fac460c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260]
Aug 16 12:37:08 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260] successful.
Aug 16 12:37:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[198957a8-416f-4e48-9de8-6741c194a22b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d47143-55f6-4e43-8854-6c2d245dcf83]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:37:08 user nova-compute[73520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:37:08 user nova-compute[73520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dc9c7f-a5b9-41cb-99cb-6dd2d3cc6da3]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:37:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJBPsaTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26338303366376231', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338303366376231', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1747553426',display_name='tempest-AttachVolumeTestJSON-server-1747553426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1747553426',id=42,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF2K5lPCqq45wlqWBJxOjnJMaqjiorbGycI/+zIIrQyDX2lqhtiNH0sOEH1miqoWIiFDFfI+JbhEvZIwSQ6ThAdNXntyvNLGxVlW0nvg7ZrlFK5UVMdROmd3/SoB5yrFw==',key_name='tempest-keypair-1911074579',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='446e9796da1f4303bb7d628fa8c8c3c3',ramdisk_id='',reservation_id='r-0o6wl00i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1174912644',owner_user_name='tempest-AttachVolumeTestJSON-1174912644-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9ef4b48f36408eba035f0d7e277dcb',uuid=26b0286b-9021-4859-88ac-760e7249a3d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converting VIF {"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG nova.objects.instance [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'pci_devices' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:37:09 user nova-compute[73520]:   <uuid>26b0286b-9021-4859-88ac-760e7249a3d2</uuid>
Aug 16 12:37:09 user nova-compute[73520]:   <name>instance-0000002a</name>
Aug 16 12:37:09 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:37:09 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:37:09 user nova-compute[73520]:   <metadata>
Aug 16 12:37:09 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:37:09 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:37:09 user nova-compute[73520]:       <nova:name>tempest-AttachVolumeTestJSON-server-1747553426</nova:name>
Aug 16 12:37:09 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:37:08</nova:creationTime>
Aug 16 12:37:09 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:37:09 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:37:09 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:37:09 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:37:09 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:37:09 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:37:09 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:37:09 user nova-compute[73520]:       <nova:owner>
Aug 16 12:37:09 user nova-compute[73520]:         <nova:user uuid="df9ef4b48f36408eba035f0d7e277dcb">tempest-AttachVolumeTestJSON-1174912644-project-member</nova:user>
Aug 16 12:37:09 user nova-compute[73520]:         <nova:project uuid="446e9796da1f4303bb7d628fa8c8c3c3">tempest-AttachVolumeTestJSON-1174912644</nova:project>
Aug 16 12:37:09 user nova-compute[73520]:       </nova:owner>
Aug 16 12:37:09 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:37:09 user nova-compute[73520]:       <nova:ports>
Aug 16 12:37:09 user nova-compute[73520]:         <nova:port uuid="6e7cef18-ea49-45cb-a7e8-3e5292b6f48f">
Aug 16 12:37:09 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 12:37:09 user nova-compute[73520]:         </nova:port>
Aug 16 12:37:09 user nova-compute[73520]:       </nova:ports>
Aug 16 12:37:09 user nova-compute[73520]:     </nova:instance>
Aug 16 12:37:09 user nova-compute[73520]:   </metadata>
Aug 16 12:37:09 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:37:09 user nova-compute[73520]:     <system>
Aug 16 12:37:09 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:37:09 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:37:09 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:37:09 user nova-compute[73520]:       <entry name="serial">26b0286b-9021-4859-88ac-760e7249a3d2</entry>
Aug 16 12:37:09 user nova-compute[73520]:       <entry name="uuid">26b0286b-9021-4859-88ac-760e7249a3d2</entry>
Aug 16 12:37:09 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:37:09 user nova-compute[73520]:     </system>
Aug 16 12:37:09 user nova-compute[73520]:   </sysinfo>
Aug 16 12:37:09 user nova-compute[73520]:   <os>
Aug 16 12:37:09 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:37:09 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:37:09 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:37:09 user nova-compute[73520]:   </os>
Aug 16 12:37:09 user nova-compute[73520]:   <features>
Aug 16 12:37:09 user nova-compute[73520]:     <acpi/>
Aug 16 12:37:09 user nova-compute[73520]:     <apic/>
Aug 16 12:37:09 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:37:09 user nova-compute[73520]:   </features>
Aug 16 12:37:09 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:37:09 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:37:09 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:37:09 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:37:09 user nova-compute[73520]:   </clock>
Aug 16 12:37:09 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:37:09 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:37:09 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:37:09 user nova-compute[73520]:   </cpu>
Aug 16 12:37:09 user nova-compute[73520]:   <devices>
Aug 16 12:37:09 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:37:09 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:37:09 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk"/>
Aug 16 12:37:09 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:37:09 user nova-compute[73520]:     </disk>
Aug 16 12:37:09 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:37:09 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:37:09 user nova-compute[73520]:       <source dev="/dev/sdb"/>
Aug 16 12:37:09 user nova-compute[73520]:       <target dev="vdb" bus="virtio"/>
Aug 16 12:37:09 user nova-compute[73520]:       <serial>f400539b-2944-4af4-b254-9ec43bfd6057</serial>
Aug 16 12:37:09 user nova-compute[73520]:     </disk>
Aug 16 12:37:09 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:37:09 user nova-compute[73520]:       <mac address="fa:16:3e:25:5f:15"/>
Aug 16 12:37:09 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:37:09 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:37:09 user nova-compute[73520]:       <target dev="tap6e7cef18-ea"/>
Aug 16 12:37:09 user nova-compute[73520]:     </interface>
Aug 16 12:37:09 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:37:09 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/console.log" append="off"/>
Aug 16 12:37:09 user nova-compute[73520]:     </serial>
Aug 16 12:37:09 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:37:09 user nova-compute[73520]:     <video>
Aug 16 12:37:09 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:37:09 user nova-compute[73520]:     </video>
Aug 16 12:37:09 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:37:09 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:37:09 user nova-compute[73520]:     </rng>
Aug 16 12:37:09 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:37:09 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:37:09 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:37:09 user nova-compute[73520]:     </memballoon>
Aug 16 12:37:09 user nova-compute[73520]:   </devices>
Aug 16 12:37:09 user nova-compute[73520]: </domain>
Aug 16 12:37:09 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG nova.objects.instance [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'trusted_certs' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.202s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Cannot resize image /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG nova.objects.instance [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'migration_context' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1747553426',display_name='tempest-AttachVolumeTestJSON-server-1747553426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1747553426',id=42,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF2K5lPCqq45wlqWBJxOjnJMaqjiorbGycI/+zIIrQyDX2lqhtiNH0sOEH1miqoWIiFDFfI+JbhEvZIwSQ6ThAdNXntyvNLGxVlW0nvg7ZrlFK5UVMdROmd3/SoB5yrFw==',key_name='tempest-keypair-1911074579',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='446e9796da1f4303bb7d628fa8c8c3c3',ramdisk_id='',reservation_id='r-0o6wl00i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1174912644',owner_user_name='tempest-AttachVolumeTestJSON-1174912644-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9ef4b48f36408eba035f0d7e277dcb',uuid=26b0286b-9021-4859-88ac-760e7249a3d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converting VIF {"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_vif [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e7cef18-ea, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e7cef18-ea, col_values=(('external_ids', {'iface-id': '6e7cef18-ea49-45cb-a7e8-3e5292b6f48f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:5f:15', 'vm-uuid': '26b0286b-9021-4859-88ac-760e7249a3d2'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:10 user nova-compute[73520]: INFO os_vif [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea')
Aug 16 12:37:10 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHbSrqgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:37:10 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:37:10 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:37:10 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a4921e-4182-4112-ab0a-86085239b48d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:37:10 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce85265f-9867-4d31-83a5-6aedf06fe7e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178] added
Aug 16 12:37:10 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d36b2e7-3c1b-4b2a-8f4e-7b734da2e165]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[166b03f5-8ba1-4285-b570-bb6022406fdd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHbSrqgy {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHbSrqgy" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7be37d-24e5-42da-b4bb-fa1d21653726]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pHbSrqgy'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[02743b18-65dc-4e0d-8b07-496f17127397]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d443ef07-4b45-4fe2-bf2c-b61fe6856b21]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:37:10 user nova-compute[73520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:10 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:37:10 user nova-compute[73520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:10 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87160f5-9f39-453b-8400-d35403cf668c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178, portal: 172.16.0.220,3260]
Aug 16 12:37:10 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178, portal: 172.16.0.220,3260] successful.
Aug 16 12:37:10 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1512c4-d26b-40a5-b051-76f74e0e757f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c892fc31-8bb6-4866-85ab-7cb363da6f2a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:37:10 user nova-compute[73520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:10 user nova-compute[73520]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 (non-flash)
Aug 16 12:37:10 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:37:10 user nova-compute[73520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:10 user nova-compute[73520]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 (non-flash)
Aug 16 12:37:10 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d755d50-0850-4030-bc39-f6a586d1c70c]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:37:10 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHbSrqgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:37:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:37:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23332363865633935', 'path': '/dev/sdd'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:37:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332363865633935', 'path': '/dev/sdd'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:37:11 user nova-compute[73520]: DEBUG nova.objects.instance [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lazy-loading 'flavor' on Instance uuid 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:37:12 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:37:12 user nova-compute[73520]:   <source dev="/dev/sdd"/>
Aug 16 12:37:12 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:37:12 user nova-compute[73520]:   <serial>d8d131ed-47ca-46fe-911b-1ab629c57178</serial>
Aug 16 12:37:12 user nova-compute[73520]: </disk>
Aug 16 12:37:12 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:37:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:37:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:37:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] No VIF found with MAC fa:16:3e:63:af:75, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:37:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0a393ea0-3bfc-4bd5-b9a6-25c0363664f3 tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.082s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-7433bf59-6b81-410e-9c4e-5eca70915df0 req-70caf891-0f55-4f43-b871-64883a67066c service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7433bf59-6b81-410e-9c4e-5eca70915df0 req-70caf891-0f55-4f43-b871-64883a67066c service nova] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7433bf59-6b81-410e-9c4e-5eca70915df0 req-70caf891-0f55-4f43-b871-64883a67066c service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7433bf59-6b81-410e-9c4e-5eca70915df0 req-70caf891-0f55-4f43-b871-64883a67066c service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-7433bf59-6b81-410e-9c4e-5eca70915df0 req-70caf891-0f55-4f43-b871-64883a67066c service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] No waiting events found dispatching network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:37:13 user nova-compute[73520]: WARNING nova.compute.manager [req-7433bf59-6b81-410e-9c4e-5eca70915df0 req-70caf891-0f55-4f43-b871-64883a67066c service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received unexpected event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f for instance with vm_state stopped and task_state powering-on.
Aug 16 12:37:14 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189434.4829693, 26b0286b-9021-4859-88ac-760e7249a3d2 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:37:14 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] VM Resumed (Lifecycle Event)
Aug 16 12:37:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:37:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Instance rebooted successfully.
Aug 16 12:37:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-85f469b8-c452-432b-9c87-1fd400e1cf88 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:37:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:37:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:37:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:14 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 12:37:14 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189434.488925, 26b0286b-9021-4859-88ac-760e7249a3d2 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:37:14 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] VM Started (Lifecycle Event)
Aug 16 12:37:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:37:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:37:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-9877f1ba-7f5b-44a1-9ca0-14b4bcee2a10 req-4d6094d4-d6e1-4c52-a09a-58ae8874d2c2 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9877f1ba-7f5b-44a1-9ca0-14b4bcee2a10 req-4d6094d4-d6e1-4c52-a09a-58ae8874d2c2 service nova] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9877f1ba-7f5b-44a1-9ca0-14b4bcee2a10 req-4d6094d4-d6e1-4c52-a09a-58ae8874d2c2 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9877f1ba-7f5b-44a1-9ca0-14b4bcee2a10 req-4d6094d4-d6e1-4c52-a09a-58ae8874d2c2 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-9877f1ba-7f5b-44a1-9ca0-14b4bcee2a10 req-4d6094d4-d6e1-4c52-a09a-58ae8874d2c2 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] No waiting events found dispatching network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:37:15 user nova-compute[73520]: WARNING nova.compute.manager [req-9877f1ba-7f5b-44a1-9ca0-14b4bcee2a10 req-4d6094d4-d6e1-4c52-a09a-58ae8874d2c2 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received unexpected event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f for instance with vm_state active and task_state None.
Aug 16 12:37:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:37:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:25 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:37:25 user nova-compute[73520]: INFO nova.compute.claims [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Claim successful on node user
Aug 16 12:37:25 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:37:25 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:37:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:37:26 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:37:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG nova.policy [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5834b6ba9f04a3ebf076c36aabb4af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3065df22890945b8a961dc7211e3b6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:37:26 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Creating image(s)
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "/opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "/opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "/opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk 1073741824" returned: 0 in 0.067s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.202s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:37:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Cannot resize image /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG nova.objects.instance [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'migration_context' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Ensure instance console log exists: /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:27 user nova-compute[73520]: INFO nova.compute.manager [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Terminating instance
Aug 16 12:37:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG nova.network.neutron [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Successfully created port: 63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-4c111d7a-e1ca-48a1-bef9-73d37b4cd777 req-e1b6278d-dd48-4ee5-826b-c4b329218cf6 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-unplugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4c111d7a-e1ca-48a1-bef9-73d37b4cd777 req-e1b6278d-dd48-4ee5-826b-c4b329218cf6 service nova] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4c111d7a-e1ca-48a1-bef9-73d37b4cd777 req-e1b6278d-dd48-4ee5-826b-c4b329218cf6 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4c111d7a-e1ca-48a1-bef9-73d37b4cd777 req-e1b6278d-dd48-4ee5-826b-c4b329218cf6 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-4c111d7a-e1ca-48a1-bef9-73d37b4cd777 req-e1b6278d-dd48-4ee5-826b-c4b329218cf6 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] No waiting events found dispatching network-vif-unplugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:37:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-4c111d7a-e1ca-48a1-bef9-73d37b4cd777 req-e1b6278d-dd48-4ee5-826b-c4b329218cf6 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-unplugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:37:28 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Instance destroyed successfully.
Aug 16 12:37:28 user nova-compute[73520]: DEBUG nova.objects.instance [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'resources' on Instance uuid ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1670743928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1670743928',id=27,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:23:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-tusldpqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:25:28Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=ba7e17f9-c32c-425d-a1ae-3e2cf9c44752,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "address": "fa:16:3e:79:4b:42", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0bbbe2f-5b", "ovs_interfaceid": "c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:4b:42,bridge_name='br-int',has_traffic_filtering=True,id=c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bbbe2f-5b') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_vif [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:4b:42,bridge_name='br-int',has_traffic_filtering=True,id=c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bbbe2f-5b') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0bbbe2f-5b, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:37:28 user nova-compute[73520]: INFO os_vif [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:4b:42,bridge_name='br-int',has_traffic_filtering=True,id=c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0bbbe2f-5b')
Aug 16 12:37:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKbLeqTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:37:28 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[759fce1c-19db-4fdb-9e36-078273ddd0d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93822fb-d704-4ebb-873c-447ceef5bcdd]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:37:28 user nova-compute[73520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:28 user nova-compute[73520]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 (non-flash)
Aug 16 12:37:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c (non-flash)
Aug 16 12:37:28 user nova-compute[73520]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:28 user nova-compute[73520]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 (non-flash)
Aug 16 12:37:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7792c3520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c'): ({'sdc'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Removing single pathed devices sdc {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5920b4f1-ea7f-4405-ae68-4f58c79e8d01]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2882a0-a643-4762-bdff-1280da538915]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Flushing IO for device /dev/sdc {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9804fb-efbd-4d1f-b11d-b2af2beeacf1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5083a52-17bb-48e2-b771-f7739154eda5]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[921c8af7-9b96-4e17-92c5-a32733c6a50a]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f73bc5-144b-40ca-9dd2-25ca72715e6c]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c, portal: 172.16.0.220,3260]
Aug 16 12:37:28 user nova-compute[73520]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c, portal: 172.16.0.220,3260] successful.
Aug 16 12:37:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d21150-539b-46cc-a671-ba0feeef3c7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[094c6861-0867-407d-9d6c-1f34916c6f04]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] <== disconnect_volume: return (348ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:37:28 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Deleting instance files /opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752_del
Aug 16 12:37:28 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Deletion of /opt/stack/data/nova/instances/ba7e17f9-c32c-425d-a1ae-3e2cf9c44752_del complete
Aug 16 12:37:28 user nova-compute[73520]: INFO nova.compute.manager [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG nova.network.neutron [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Successfully updated port: 63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquired lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG nova.network.neutron [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:37:28 user nova-compute[73520]: DEBUG nova.network.neutron [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.network.neutron [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updating instance_info_cache with network_info: [{"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Releasing lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Instance network_info: |[{"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Start _get_guest_xml network_info=[{"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:37:29 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:37:29 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:37:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1058091349',display_name='tempest-SnapshotDataIntegrityTests-server-1058091349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1058091349',id=46,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBae3l9iLlsGkBww5Z1lclD3whXbmjd0jQKRjFfgHZ/M6kcOBSGzvQqtVGBcJXjXA+KR1rJhjITUfDBxU+yjDBP/1UbYMFwAXxAZ6bxxsjbiZX1fX7xUas7La1066XABOQ==',key_name='tempest-keypair-1504047710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3065df22890945b8a961dc7211e3b6dc',ramdisk_id='',reservation_id='r-hp0iu66j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-353803011',owner_user_name='tempest-SnapshotDataIntegrityTests-353803011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5834b6ba9f04a3ebf076c36aabb4af5',uuid=d034d519-491c-4963-95b1-48eaf2d81653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Converting VIF {"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:87:09,bridge_name='br-int',has_traffic_filtering=True,id=63a2fe18-23e4-4eaa-9a52-aab734ec0bec,network=Network(ab8bdcaf-fbd4-4773-91f3-43d287f12d7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a2fe18-23') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.objects.instance [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'pci_devices' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:37:29 user nova-compute[73520]:   <uuid>d034d519-491c-4963-95b1-48eaf2d81653</uuid>
Aug 16 12:37:29 user nova-compute[73520]:   <name>instance-0000002e</name>
Aug 16 12:37:29 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:37:29 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:37:29 user nova-compute[73520]:   <metadata>
Aug 16 12:37:29 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:37:29 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:37:29 user nova-compute[73520]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1058091349</nova:name>
Aug 16 12:37:29 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:37:29</nova:creationTime>
Aug 16 12:37:29 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:37:29 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:37:29 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:37:29 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:37:29 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:37:29 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:37:29 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:37:29 user nova-compute[73520]:       <nova:owner>
Aug 16 12:37:29 user nova-compute[73520]:         <nova:user uuid="c5834b6ba9f04a3ebf076c36aabb4af5">tempest-SnapshotDataIntegrityTests-353803011-project-member</nova:user>
Aug 16 12:37:29 user nova-compute[73520]:         <nova:project uuid="3065df22890945b8a961dc7211e3b6dc">tempest-SnapshotDataIntegrityTests-353803011</nova:project>
Aug 16 12:37:29 user nova-compute[73520]:       </nova:owner>
Aug 16 12:37:29 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:37:29 user nova-compute[73520]:       <nova:ports>
Aug 16 12:37:29 user nova-compute[73520]:         <nova:port uuid="63a2fe18-23e4-4eaa-9a52-aab734ec0bec">
Aug 16 12:37:29 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 12:37:29 user nova-compute[73520]:         </nova:port>
Aug 16 12:37:29 user nova-compute[73520]:       </nova:ports>
Aug 16 12:37:29 user nova-compute[73520]:     </nova:instance>
Aug 16 12:37:29 user nova-compute[73520]:   </metadata>
Aug 16 12:37:29 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:37:29 user nova-compute[73520]:     <system>
Aug 16 12:37:29 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:37:29 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:37:29 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:37:29 user nova-compute[73520]:       <entry name="serial">d034d519-491c-4963-95b1-48eaf2d81653</entry>
Aug 16 12:37:29 user nova-compute[73520]:       <entry name="uuid">d034d519-491c-4963-95b1-48eaf2d81653</entry>
Aug 16 12:37:29 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:37:29 user nova-compute[73520]:     </system>
Aug 16 12:37:29 user nova-compute[73520]:   </sysinfo>
Aug 16 12:37:29 user nova-compute[73520]:   <os>
Aug 16 12:37:29 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:37:29 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:37:29 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:37:29 user nova-compute[73520]:   </os>
Aug 16 12:37:29 user nova-compute[73520]:   <features>
Aug 16 12:37:29 user nova-compute[73520]:     <acpi/>
Aug 16 12:37:29 user nova-compute[73520]:     <apic/>
Aug 16 12:37:29 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:37:29 user nova-compute[73520]:   </features>
Aug 16 12:37:29 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:37:29 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:37:29 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:37:29 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:37:29 user nova-compute[73520]:   </clock>
Aug 16 12:37:29 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:37:29 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:37:29 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:37:29 user nova-compute[73520]:   </cpu>
Aug 16 12:37:29 user nova-compute[73520]:   <devices>
Aug 16 12:37:29 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:37:29 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:37:29 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk"/>
Aug 16 12:37:29 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:37:29 user nova-compute[73520]:     </disk>
Aug 16 12:37:29 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:37:29 user nova-compute[73520]:       <mac address="fa:16:3e:43:87:09"/>
Aug 16 12:37:29 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:37:29 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:37:29 user nova-compute[73520]:       <target dev="tap63a2fe18-23"/>
Aug 16 12:37:29 user nova-compute[73520]:     </interface>
Aug 16 12:37:29 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:37:29 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/console.log" append="off"/>
Aug 16 12:37:29 user nova-compute[73520]:     </serial>
Aug 16 12:37:29 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:37:29 user nova-compute[73520]:     <video>
Aug 16 12:37:29 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:37:29 user nova-compute[73520]:     </video>
Aug 16 12:37:29 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:37:29 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:37:29 user nova-compute[73520]:     </rng>
Aug 16 12:37:29 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:37:29 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:37:29 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:37:29 user nova-compute[73520]:     </memballoon>
Aug 16 12:37:29 user nova-compute[73520]:   </devices>
Aug 16 12:37:29 user nova-compute[73520]: </domain>
Aug 16 12:37:29 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:37:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1058091349',display_name='tempest-SnapshotDataIntegrityTests-server-1058091349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1058091349',id=46,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBae3l9iLlsGkBww5Z1lclD3whXbmjd0jQKRjFfgHZ/M6kcOBSGzvQqtVGBcJXjXA+KR1rJhjITUfDBxU+yjDBP/1UbYMFwAXxAZ6bxxsjbiZX1fX7xUas7La1066XABOQ==',key_name='tempest-keypair-1504047710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3065df22890945b8a961dc7211e3b6dc',ramdisk_id='',reservation_id='r-hp0iu66j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-353803011',owner_user_name='tempest-SnapshotDataIntegrityTests-353803011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5834b6ba9f04a3ebf076c36aabb4af5',uuid=d034d519-491c-4963-95b1-48eaf2d81653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Converting VIF {"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:87:09,bridge_name='br-int',has_traffic_filtering=True,id=63a2fe18-23e4-4eaa-9a52-aab734ec0bec,network=Network(ab8bdcaf-fbd4-4773-91f3-43d287f12d7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a2fe18-23') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG os_vif [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:87:09,bridge_name='br-int',has_traffic_filtering=True,id=63a2fe18-23e4-4eaa-9a52-aab734ec0bec,network=Network(ab8bdcaf-fbd4-4773-91f3-43d287f12d7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a2fe18-23') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63a2fe18-23, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63a2fe18-23, col_values=(('external_ids', {'iface-id': '63a2fe18-23e4-4eaa-9a52-aab734ec0bec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:87:09', 'vm-uuid': 'd034d519-491c-4963-95b1-48eaf2d81653'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:29 user nova-compute[73520]: INFO os_vif [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:87:09,bridge_name='br-int',has_traffic_filtering=True,id=63a2fe18-23e4-4eaa-9a52-aab734ec0bec,network=Network(ab8bdcaf-fbd4-4773-91f3-43d287f12d7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a2fe18-23')
Aug 16 12:37:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-69c728be-130c-429b-8e1b-200d327ef71b req-4dc5be60-a9f9-4360-8ca1-04e62d3d0c87 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-deleted-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:29 user nova-compute[73520]: INFO nova.compute.manager [req-69c728be-130c-429b-8e1b-200d327ef71b req-4dc5be60-a9f9-4360-8ca1-04e62d3d0c87 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Neutron deleted interface c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b; detaching it from the instance and deleting it from the info cache
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.network.neutron [req-69c728be-130c-429b-8e1b-200d327ef71b req-4dc5be60-a9f9-4360-8ca1-04e62d3d0c87 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No VIF found with MAC fa:16:3e:43:87:09, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-69c728be-130c-429b-8e1b-200d327ef71b req-4dc5be60-a9f9-4360-8ca1-04e62d3d0c87 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Detach interface failed, port_id=c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b, reason: Instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:37:29 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Took 1.13 seconds to deallocate network for instance.
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] Acquiring lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] No waiting events found dispatching network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:37:29 user nova-compute[73520]: WARNING nova.compute.manager [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Received unexpected event network-vif-plugged-c0bbbe2f-5ba5-42d2-b51a-4eb345cf7a6b for instance with vm_state active and task_state deleting.
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Received event network-changed-63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.compute.manager [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Refreshing instance network info cache due to event network-changed-63a2fe18-23e4-4eaa-9a52-aab734ec0bec. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] Acquiring lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] Acquired lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:37:29 user nova-compute[73520]: DEBUG nova.network.neutron [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Refreshing network info cache for port 63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:37:30 user nova-compute[73520]: DEBUG nova.network.neutron [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updated VIF entry in instance network info cache for port 63a2fe18-23e4-4eaa-9a52-aab734ec0bec. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:37:30 user nova-compute[73520]: DEBUG nova.network.neutron [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updating instance_info_cache with network_info: [{"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:37:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-483dc2b6-fbd0-4fa0-9a4e-f32920773be1 req-4a6daf36-59eb-4d7e-aaf1-0f063af83e00 service nova] Releasing lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:37:30 user nova-compute[73520]: INFO nova.compute.manager [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Took 0.81 seconds to detach 1 volumes for instance.
Aug 16 12:37:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:30 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:31 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Deleted allocations for instance ba7e17f9-c32c-425d-a1ae-3e2cf9c44752
Aug 16 12:37:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17ac503b-b98e-4cfe-ba15-7c2f859de9d1 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "ba7e17f9-c32c-425d-a1ae-3e2cf9c44752" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.916s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-c8b96aed-bcb2-487a-9cec-04e907d9832f req-5c61750b-5c76-44b0-b9bd-16a3882b915a service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Received event network-vif-plugged-63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c8b96aed-bcb2-487a-9cec-04e907d9832f req-5c61750b-5c76-44b0-b9bd-16a3882b915a service nova] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c8b96aed-bcb2-487a-9cec-04e907d9832f req-5c61750b-5c76-44b0-b9bd-16a3882b915a service nova] Lock "d034d519-491c-4963-95b1-48eaf2d81653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c8b96aed-bcb2-487a-9cec-04e907d9832f req-5c61750b-5c76-44b0-b9bd-16a3882b915a service nova] Lock "d034d519-491c-4963-95b1-48eaf2d81653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-c8b96aed-bcb2-487a-9cec-04e907d9832f req-5c61750b-5c76-44b0-b9bd-16a3882b915a service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] No waiting events found dispatching network-vif-plugged-63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:37:32 user nova-compute[73520]: WARNING nova.compute.manager [req-c8b96aed-bcb2-487a-9cec-04e907d9832f req-5c61750b-5c76-44b0-b9bd-16a3882b915a service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Received unexpected event network-vif-plugged-63a2fe18-23e4-4eaa-9a52-aab734ec0bec for instance with vm_state building and task_state spawning.
Aug 16 12:37:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189453.487782, d034d519-491c-4963-95b1-48eaf2d81653 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:37:33 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] VM Resumed (Lifecycle Event)
Aug 16 12:37:33 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Instance spawned successfully.
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:37:33 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189453.4881034, d034d519-491c-4963-95b1-48eaf2d81653 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:37:33 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] VM Started (Lifecycle Event)
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:37:33 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:37:33 user nova-compute[73520]: INFO nova.compute.manager [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Took 7.33 seconds to spawn the instance on the hypervisor.
Aug 16 12:37:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:37:33 user nova-compute[73520]: INFO nova.compute.manager [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Took 8.16 seconds to build instance.
Aug 16 12:37:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-96132693-587a-4e66-bf18-d5160cc91518 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.256s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:34 user nova-compute[73520]: DEBUG nova.compute.manager [req-9c94fac5-fe83-4574-bbb1-8ee5b7382cd8 req-4a7d625d-b2bf-41bf-b455-4f45a5b2de9f service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Received event network-vif-plugged-63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9c94fac5-fe83-4574-bbb1-8ee5b7382cd8 req-4a7d625d-b2bf-41bf-b455-4f45a5b2de9f service nova] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9c94fac5-fe83-4574-bbb1-8ee5b7382cd8 req-4a7d625d-b2bf-41bf-b455-4f45a5b2de9f service nova] Lock "d034d519-491c-4963-95b1-48eaf2d81653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9c94fac5-fe83-4574-bbb1-8ee5b7382cd8 req-4a7d625d-b2bf-41bf-b455-4f45a5b2de9f service nova] Lock "d034d519-491c-4963-95b1-48eaf2d81653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:34 user nova-compute[73520]: DEBUG nova.compute.manager [req-9c94fac5-fe83-4574-bbb1-8ee5b7382cd8 req-4a7d625d-b2bf-41bf-b455-4f45a5b2de9f service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] No waiting events found dispatching network-vif-plugged-63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:37:34 user nova-compute[73520]: WARNING nova.compute.manager [req-9c94fac5-fe83-4574-bbb1-8ee5b7382cd8 req-4a7d625d-b2bf-41bf-b455-4f45a5b2de9f service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Received unexpected event network-vif-plugged-63a2fe18-23e4-4eaa-9a52-aab734ec0bec for instance with vm_state active and task_state None.
Aug 16 12:37:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:43 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189448.2190366, ba7e17f9-c32c-425d-a1ae-3e2cf9c44752 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:37:43 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] VM Stopped (Lifecycle Event)
Aug 16 12:37:43 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dbcc90fc-7b38-42fe-ae96-2b8ea5814818 None None] [instance: ba7e17f9-c32c-425d-a1ae-3e2cf9c44752] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:37:43 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:37:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:37:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:37:44 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:37:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:37:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:37:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:50 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:37:52 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:37:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:53 user nova-compute[73520]: INFO nova.compute.manager [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Detaching volume d8d131ed-47ca-46fe-911b-1ab629c57178
Aug 16 12:37:53 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:37:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:53 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:54 user nova-compute[73520]: INFO nova.virt.block_device [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Attempting to driver detach volume d8d131ed-47ca-46fe-911b-1ab629c57178 from mountpoint /dev/vdb
Aug 16 12:37:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Attempting to detach device vdb from instance 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:37:54 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:37:54 user nova-compute[73520]:   <source dev="/dev/sdd"/>
Aug 16 12:37:54 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:37:54 user nova-compute[73520]:   <serial>d8d131ed-47ca-46fe-911b-1ab629c57178</serial>
Aug 16 12:37:54 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:37:54 user nova-compute[73520]: </disk>
Aug 16 12:37:54 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:37:54 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Successfully detached device vdb from instance 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 from the persistent domain config.
Aug 16 12:37:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:37:54 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:37:54 user nova-compute[73520]:   <source dev="/dev/sdd"/>
Aug 16 12:37:54 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:37:54 user nova-compute[73520]:   <serial>d8d131ed-47ca-46fe-911b-1ab629c57178</serial>
Aug 16 12:37:54 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:37:54 user nova-compute[73520]: </disk>
Aug 16 12:37:54 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692189474.5749102, 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:37:54 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Successfully detached device vdb from instance 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 from the live domain config.
Aug 16 12:37:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHbSrqgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:37:54 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1ca186-2b22-4378-8414-8610d620131d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc93baf5-9b04-4a11-9520-def6c9fcd317]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:54 user nova-compute[73520]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 (non-flash)
Aug 16 12:37:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:54 user nova-compute[73520]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 (non-flash)
Aug 16 12:37:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c7d5ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178'): ({'sdd'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Removing single pathed devices sdd {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[488a4ece-2b28-4c63-8487-4af96f298372]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a325c5fc-88e7-48ef-9050-ffde8751453b]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Flushing IO for device /dev/sdd {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6de187c-89ef-47a9-afd8-db22751cf15e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6dcba7-79d0-49be-be8a-f3243593a48d]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] SCSI volumes sdd have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83b2925-c50d-4fd2-a9d9-fbf2603fe27b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e85b79-7f7e-4298-9f53-f66c3394e7af]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178, portal: 172.16.0.220,3260]
Aug 16 12:37:54 user nova-compute[73520]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178, portal: 172.16.0.220,3260] successful.
Aug 16 12:37:54 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b09ba7-4078-4695-8a8d-c9b3a8dfb533]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] <== disconnect_volume: return (290ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:37:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "4926037c-8e89-4923-940f-9837b053b9a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "4926037c-8e89-4923-940f-9837b053b9a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "4926037c-8e89-4923-940f-9837b053b9a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:56 user nova-compute[73520]: INFO nova.compute.manager [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Terminating instance
Aug 16 12:37:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lazy-loading 'flavor' on Instance uuid 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b7a93b3d-9d6e-4973-97e9-60333ce7a18d tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.595s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.492s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:56 user nova-compute[73520]: INFO nova.compute.manager [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Terminating instance
Aug 16 12:37:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-cc184419-6b19-436a-a88f-776bf518c6cf req-1703f422-a550-426b-9dea-c0940b4305e4 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received event network-vif-unplugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cc184419-6b19-436a-a88f-776bf518c6cf req-1703f422-a550-426b-9dea-c0940b4305e4 service nova] Acquiring lock "4926037c-8e89-4923-940f-9837b053b9a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cc184419-6b19-436a-a88f-776bf518c6cf req-1703f422-a550-426b-9dea-c0940b4305e4 service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cc184419-6b19-436a-a88f-776bf518c6cf req-1703f422-a550-426b-9dea-c0940b4305e4 service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-cc184419-6b19-436a-a88f-776bf518c6cf req-1703f422-a550-426b-9dea-c0940b4305e4 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] No waiting events found dispatching network-vif-unplugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-cc184419-6b19-436a-a88f-776bf518c6cf req-1703f422-a550-426b-9dea-c0940b4305e4 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received event network-vif-unplugged-78cef49e-d317-4d37-8da3-d72d0b755c2d for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-903c066c-2933-41bc-95c7-7a968748d797 req-d99d38b5-6db4-4d0b-b708-5b3dabaebde2 service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Received event network-vif-unplugged-b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-903c066c-2933-41bc-95c7-7a968748d797 req-d99d38b5-6db4-4d0b-b708-5b3dabaebde2 service nova] Acquiring lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-903c066c-2933-41bc-95c7-7a968748d797 req-d99d38b5-6db4-4d0b-b708-5b3dabaebde2 service nova] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-903c066c-2933-41bc-95c7-7a968748d797 req-d99d38b5-6db4-4d0b-b708-5b3dabaebde2 service nova] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-903c066c-2933-41bc-95c7-7a968748d797 req-d99d38b5-6db4-4d0b-b708-5b3dabaebde2 service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] No waiting events found dispatching network-vif-unplugged-b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:37:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-903c066c-2933-41bc-95c7-7a968748d797 req-d99d38b5-6db4-4d0b-b708-5b3dabaebde2 service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Received event network-vif-unplugged-b24cb0a1-1a5f-4285-a039-d96713541f95 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:57 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Instance destroyed successfully.
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'resources' on Instance uuid 4926037c-8e89-4923-940f-9837b053b9a0 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-978581289',display_name='tempest-ServerRescueNegativeTestJSON-server-978581289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-978581289',id=26,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:23:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930fb7964e2942c88c3416be172c6884',ramdisk_id='',reservation_id='r-gkbk7dsy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-863509458',owner_user_name='tempest-ServerRescueNegativeTestJSON-863509458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:23:29Z,user_data=None,user_id='0d351d0adad3463ebb2e6917a5f91920',uuid=4926037c-8e89-4923-940f-9837b053b9a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converting VIF {"id": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "address": "fa:16:3e:a8:58:db", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78cef49e-d3", "ovs_interfaceid": "78cef49e-d317-4d37-8da3-d72d0b755c2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:58:db,bridge_name='br-int',has_traffic_filtering=True,id=78cef49e-d317-4d37-8da3-d72d0b755c2d,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78cef49e-d3') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG os_vif [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:58:db,bridge_name='br-int',has_traffic_filtering=True,id=78cef49e-d317-4d37-8da3-d72d0b755c2d,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78cef49e-d3') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78cef49e-d3, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:37:57 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Instance destroyed successfully.
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lazy-loading 'resources' on Instance uuid 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:57 user nova-compute[73520]: INFO os_vif [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:58:db,bridge_name='br-int',has_traffic_filtering=True,id=78cef49e-d317-4d37-8da3-d72d0b755c2d,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78cef49e-d3')
Aug 16 12:37:57 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Deleting instance files /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0_del
Aug 16 12:37:57 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Deletion of /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0_del complete
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1632601042',display_name='tempest-VolumesSnapshotTestJSON-instance-1632601042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1632601042',id=45,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFMHcAITaSfVXToHLw2ue7G5El/M7lYEyUhAqjgcbcAAhsdEEjlOrfPVNhpVkPIjS21sPgvk7Oxba1oX1toJGXC66nsoxdAImo8RGlKpY7AFEqa3xcfbNOQSgO7LO9vnQ==',key_name='tempest-keypair-1854279134',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:35:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1870ba83d8124a6c9624afde2cdd3752',ramdisk_id='',reservation_id='r-kc2rjjf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1304228647',owner_user_name='tempest-VolumesSnapshotTestJSON-1304228647-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d1fb48f56ed426b8cc984a7973ab208',uuid=1e3d30e6-7800-4dd9-88ae-6abe48c980e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b24cb0a1-1a5f-4285-a039-d96713541f95", "address": "fa:16:3e:63:af:75", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24cb0a1-1a", "ovs_interfaceid": "b24cb0a1-1a5f-4285-a039-d96713541f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Converting VIF {"id": "b24cb0a1-1a5f-4285-a039-d96713541f95", "address": "fa:16:3e:63:af:75", "network": {"id": "89517987-442a-4694-b6a2-ae3184d6f1e7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-724456646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1870ba83d8124a6c9624afde2cdd3752", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24cb0a1-1a", "ovs_interfaceid": "b24cb0a1-1a5f-4285-a039-d96713541f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:af:75,bridge_name='br-int',has_traffic_filtering=True,id=b24cb0a1-1a5f-4285-a039-d96713541f95,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24cb0a1-1a') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG os_vif [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:af:75,bridge_name='br-int',has_traffic_filtering=True,id=b24cb0a1-1a5f-4285-a039-d96713541f95,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24cb0a1-1a') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb24cb0a1-1a, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json" returned: 1 in 0.227s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk --force-share --output=json' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:37:57 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001a, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/4926037c-8e89-4923-940f-9837b053b9a0/disk
Aug 16 12:37:57 user nova-compute[73520]: INFO os_vif [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:af:75,bridge_name='br-int',has_traffic_filtering=True,id=b24cb0a1-1a5f-4285-a039-d96713541f95,network=Network(89517987-442a-4694-b6a2-ae3184d6f1e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24cb0a1-1a')
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHbSrqgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:37:57 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:37:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8d131ed-47ca-46fe-911b-1ab629c57178', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0d465b-9738-4a6d-94a8-e740e2e699aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78c38f4-044f-464e-8c88-420b0d2e8ba7]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:57 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:37:57 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c11f6d0>, {}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Disconnecting from: [] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.091s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] <== disconnect_volume: return (92ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:37:57 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Deleting instance files /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5_del
Aug 16 12:37:57 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Deletion of /opt/stack/data/nova/instances/1e3d30e6-7800-4dd9-88ae-6abe48c980e5_del complete
Aug 16 12:37:57 user nova-compute[73520]: INFO nova.compute.manager [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Took 1.47 seconds to destroy the instance on the hypervisor.
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:37:57 user nova-compute[73520]: INFO nova.compute.manager [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Took 1.38 seconds to destroy the instance on the hypervisor.
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:37:57 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:37:57 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:37:57 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=7923MB free_disk=25.16228485107422GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 14e89425-93b9-4005-bee2-2b7cc871ee13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 6ed1c5ac-d727-4157-a294-55b49ed26eea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 4926037c-8e89-4923-940f-9837b053b9a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 26b0286b-9021-4859-88ac-760e7249a3d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d034d519-491c-4963-95b1-48eaf2d81653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:37:58 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Took 0.54 seconds to deallocate network for instance.
Aug 16 12:37:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-c5538fbf-7d5a-4d7f-a9ca-c767166939d9 req-3d1147be-7a70-4b6c-9ab1-647309c449d1 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received event network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c5538fbf-7d5a-4d7f-a9ca-c767166939d9 req-3d1147be-7a70-4b6c-9ab1-647309c449d1 service nova] Acquiring lock "4926037c-8e89-4923-940f-9837b053b9a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c5538fbf-7d5a-4d7f-a9ca-c767166939d9 req-3d1147be-7a70-4b6c-9ab1-647309c449d1 service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c5538fbf-7d5a-4d7f-a9ca-c767166939d9 req-3d1147be-7a70-4b6c-9ab1-647309c449d1 service nova] Lock "4926037c-8e89-4923-940f-9837b053b9a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-c5538fbf-7d5a-4d7f-a9ca-c767166939d9 req-3d1147be-7a70-4b6c-9ab1-647309c449d1 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] No waiting events found dispatching network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:37:58 user nova-compute[73520]: WARNING nova.compute.manager [req-c5538fbf-7d5a-4d7f-a9ca-c767166939d9 req-3d1147be-7a70-4b6c-9ab1-647309c449d1 service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received unexpected event network-vif-plugged-78cef49e-d317-4d37-8da3-d72d0b755c2d for instance with vm_state deleted and task_state None.
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:58 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Deleted allocations for instance 4926037c-8e89-4923-940f-9837b053b9a0
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:37:58 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Took 0.91 seconds to deallocate network for instance.
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-7750ec3d-e4ee-4e31-b068-dab33f52c374 req-edc97904-c552-4b2c-9cc9-541f274f75ea service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Received event network-vif-deleted-b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:58 user nova-compute[73520]: INFO nova.compute.manager [req-7750ec3d-e4ee-4e31-b068-dab33f52c374 req-edc97904-c552-4b2c-9cc9-541f274f75ea service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Neutron deleted interface b24cb0a1-1a5f-4285-a039-d96713541f95; detaching it from the instance and deleting it from the info cache
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.network.neutron [req-7750ec3d-e4ee-4e31-b068-dab33f52c374 req-edc97904-c552-4b2c-9cc9-541f274f75ea service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:37:58 user nova-compute[73520]: WARNING nova.volume.cinder [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Attachment c7149116-35c1-4bc8-ab1c-ec361f974c3b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c7149116-35c1-4bc8-ab1c-ec361f974c3b. (HTTP 404) (Request-ID: req-9bb769e1-01f9-46d4-840f-b42bb64af14d)
Aug 16 12:37:58 user nova-compute[73520]: INFO nova.compute.manager [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Took 0.03 seconds to detach 1 volumes for instance.
Aug 16 12:37:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-7750ec3d-e4ee-4e31-b068-dab33f52c374 req-edc97904-c552-4b2c-9cc9-541f274f75ea service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Detach interface failed, port_id=b24cb0a1-1a5f-4285-a039-d96713541f95, reason: Instance 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b5ac2aa3-f131-4669-bcd3-a66b1432b495 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "4926037c-8e89-4923-940f-9837b053b9a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.916s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:59 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:37:59 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:37:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:59 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Deleted allocations for instance 1e3d30e6-7800-4dd9-88ae-6abe48c980e5
Aug 16 12:37:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b8b5e244-b993-43bb-bbd6-6d8150ba196a tempest-VolumesSnapshotTestJSON-1304228647 tempest-VolumesSnapshotTestJSON-1304228647-project-member] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.843s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-c28f053d-b1fe-4f2a-a8c0-a6612b2ef8ff req-973b41ae-45f1-4a25-a79d-7b7212e3dadd service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Received event network-vif-plugged-b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c28f053d-b1fe-4f2a-a8c0-a6612b2ef8ff req-973b41ae-45f1-4a25-a79d-7b7212e3dadd service nova] Acquiring lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:37:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c28f053d-b1fe-4f2a-a8c0-a6612b2ef8ff req-973b41ae-45f1-4a25-a79d-7b7212e3dadd service nova] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:37:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c28f053d-b1fe-4f2a-a8c0-a6612b2ef8ff req-973b41ae-45f1-4a25-a79d-7b7212e3dadd service nova] Lock "1e3d30e6-7800-4dd9-88ae-6abe48c980e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:37:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-c28f053d-b1fe-4f2a-a8c0-a6612b2ef8ff req-973b41ae-45f1-4a25-a79d-7b7212e3dadd service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] No waiting events found dispatching network-vif-plugged-b24cb0a1-1a5f-4285-a039-d96713541f95 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:37:59 user nova-compute[73520]: WARNING nova.compute.manager [req-c28f053d-b1fe-4f2a-a8c0-a6612b2ef8ff req-973b41ae-45f1-4a25-a79d-7b7212e3dadd service nova] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Received unexpected event network-vif-plugged-b24cb0a1-1a5f-4285-a039-d96713541f95 for instance with vm_state deleted and task_state None.
Aug 16 12:37:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-c28f053d-b1fe-4f2a-a8c0-a6612b2ef8ff req-973b41ae-45f1-4a25-a79d-7b7212e3dadd service nova] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Received event network-vif-deleted-78cef49e-d317-4d37-8da3-d72d0b755c2d {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:37:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:01 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:38:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:38:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:38:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:38:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:38:01 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:38:01 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 14e89425-93b9-4005-bee2-2b7cc871ee13 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:38:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:02 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Updating instance_info_cache with network_info: [{"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:38:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-14e89425-93b9-4005-bee2-2b7cc871ee13" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:38:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:38:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:12 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189477.271913, 4926037c-8e89-4923-940f-9837b053b9a0 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:38:12 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] VM Stopped (Lifecycle Event)
Aug 16 12:38:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-02d2b72c-e3e0-4d3a-beaa-f2cd537c0cd2 None None] [instance: 4926037c-8e89-4923-940f-9837b053b9a0] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:38:12 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189477.3356073, 1e3d30e6-7800-4dd9-88ae-6abe48c980e5 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:38:12 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] VM Stopped (Lifecycle Event)
Aug 16 12:38:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-84203433-e147-4e26-8271-b6f07bafb06d None None] [instance: 1e3d30e6-7800-4dd9-88ae-6abe48c980e5] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:38:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:38:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:38:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:38:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:38:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:15 user nova-compute[73520]: INFO nova.compute.manager [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Unshelving
Aug 16 12:38:15 user nova-compute[73520]: INFO nova.virt.block_device [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Booting with volume acf4e063-0578-4e92-88ad-c7a8e4bf9679 at /dev/vda
Aug 16 12:38:15 user nova-compute[73520]: DEBUG os_brick.utils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15e7255-e461-43b4-987c-70d87c6505b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce9a683-cf42-47e7-a760-bd8e475b0b73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[44817900-cf83-43e9-9b52-059f80515087]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa54549-5072-4381-a645-32f7caae3f33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:38:15 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:38:15 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9f212a-6919-4d55-995b-8ba74cea57f1]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG os_brick.utils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:38:15 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updating existing volume attachment record: 14108dac-afa7-4b94-9a17-3cd9d4d434d1 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:38:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "14e89425-93b9-4005-bee2-2b7cc871ee13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:18 user nova-compute[73520]: INFO nova.compute.manager [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Terminating instance
Aug 16 12:38:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:38:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-cef11eb4-405a-4b0c-b51c-be19297bc4da req-c9e87ed3-b409-441c-922d-0d5cbf01180c service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Received event network-vif-unplugged-f959bb38-4830-456d-bd98-dd621fdb5420 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cef11eb4-405a-4b0c-b51c-be19297bc4da req-c9e87ed3-b409-441c-922d-0d5cbf01180c service nova] Acquiring lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cef11eb4-405a-4b0c-b51c-be19297bc4da req-c9e87ed3-b409-441c-922d-0d5cbf01180c service nova] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cef11eb4-405a-4b0c-b51c-be19297bc4da req-c9e87ed3-b409-441c-922d-0d5cbf01180c service nova] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-cef11eb4-405a-4b0c-b51c-be19297bc4da req-c9e87ed3-b409-441c-922d-0d5cbf01180c service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] No waiting events found dispatching network-vif-unplugged-f959bb38-4830-456d-bd98-dd621fdb5420 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG nova.compute.manager [req-cef11eb4-405a-4b0c-b51c-be19297bc4da req-c9e87ed3-b409-441c-922d-0d5cbf01180c service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Received event network-vif-unplugged-f959bb38-4830-456d-bd98-dd621fdb5420 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:38:19 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Instance destroyed successfully.
Aug 16 12:38:19 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lazy-loading 'resources' on Instance uuid 14e89425-93b9-4005-bee2-2b7cc871ee13 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-324983927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-324983927',id=17,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d3756b80f2243dca0b31ffea7438b5d',ramdisk_id='',reservation_id='r-hvh4o0w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:20:35Z,user_data=None,user_id='3d1e9417253f43b482e8ee5b3109a697',uuid=14e89425-93b9-4005-bee2-2b7cc871ee13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converting VIF {"id": "f959bb38-4830-456d-bd98-dd621fdb5420", "address": "fa:16:3e:5b:97:ea", "network": {"id": "7f380810-0319-4659-a1a7-98dfd4ac544a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1498845363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d3756b80f2243dca0b31ffea7438b5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf959bb38-48", "ovs_interfaceid": "f959bb38-4830-456d-bd98-dd621fdb5420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:97:ea,bridge_name='br-int',has_traffic_filtering=True,id=f959bb38-4830-456d-bd98-dd621fdb5420,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf959bb38-48') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG os_vif [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:97:ea,bridge_name='br-int',has_traffic_filtering=True,id=f959bb38-4830-456d-bd98-dd621fdb5420,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf959bb38-48') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf959bb38-48, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:38:19 user nova-compute[73520]: INFO os_vif [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:97:ea,bridge_name='br-int',has_traffic_filtering=True,id=f959bb38-4830-456d-bd98-dd621fdb5420,network=Network(7f380810-0319-4659-a1a7-98dfd4ac544a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf959bb38-48')
Aug 16 12:38:19 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Deleting instance files /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13_del
Aug 16 12:38:19 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Deletion of /opt/stack/data/nova/instances/14e89425-93b9-4005-bee2-2b7cc871ee13_del complete
Aug 16 12:38:19 user nova-compute[73520]: INFO nova.compute.manager [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 12:38:19 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:38:19 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:38:20 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:38:20 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Took 0.62 seconds to deallocate network for instance.
Aug 16 12:38:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:20 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:38:20 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:38:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:20 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Deleted allocations for instance 14e89425-93b9-4005-bee2-2b7cc871ee13
Aug 16 12:38:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fde03a-8f07-4830-aa00-ab926ed03ad5 tempest-ServerBootFromVolumeStableRescueTest-1104312883 tempest-ServerBootFromVolumeStableRescueTest-1104312883-project-member] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.860s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-2af812cf-4833-469f-84fd-fe821d8c4dec req-fbed5b79-d234-4712-bdd4-090f11a6261a service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Received event network-vif-plugged-f959bb38-4830-456d-bd98-dd621fdb5420 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:38:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2af812cf-4833-469f-84fd-fe821d8c4dec req-fbed5b79-d234-4712-bdd4-090f11a6261a service nova] Acquiring lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2af812cf-4833-469f-84fd-fe821d8c4dec req-fbed5b79-d234-4712-bdd4-090f11a6261a service nova] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2af812cf-4833-469f-84fd-fe821d8c4dec req-fbed5b79-d234-4712-bdd4-090f11a6261a service nova] Lock "14e89425-93b9-4005-bee2-2b7cc871ee13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-2af812cf-4833-469f-84fd-fe821d8c4dec req-fbed5b79-d234-4712-bdd4-090f11a6261a service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] No waiting events found dispatching network-vif-plugged-f959bb38-4830-456d-bd98-dd621fdb5420 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:38:21 user nova-compute[73520]: WARNING nova.compute.manager [req-2af812cf-4833-469f-84fd-fe821d8c4dec req-fbed5b79-d234-4712-bdd4-090f11a6261a service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Received unexpected event network-vif-plugged-f959bb38-4830-456d-bd98-dd621fdb5420 for instance with vm_state deleted and task_state None.
Aug 16 12:38:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-2af812cf-4833-469f-84fd-fe821d8c4dec req-fbed5b79-d234-4712-bdd4-090f11a6261a service nova] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Received event network-vif-deleted-f959bb38-4830-456d-bd98-dd621fdb5420 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:38:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:25 user nova-compute[73520]: DEBUG nova.objects.instance [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lazy-loading 'pci_requests' on Instance uuid 87762694-f7bc-44b4-a37b-7f9e11fdd627 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:38:26 user nova-compute[73520]: DEBUG nova.objects.instance [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lazy-loading 'numa_topology' on Instance uuid 87762694-f7bc-44b4-a37b-7f9e11fdd627 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:38:26 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:38:26 user nova-compute[73520]: INFO nova.compute.claims [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Claim successful on node user
Aug 16 12:38:26 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:38:26 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:38:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:26 user nova-compute[73520]: INFO nova.network.neutron [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updating port 4f15c60a-7230-4011-9f93-15cf877d4bb9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 12:38:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:38:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquired lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:38:27 user nova-compute[73520]: DEBUG nova.network.neutron [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:38:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-9a69a03f-0190-4459-88d7-deec2419df20 req-26fb7886-5a6c-4c27-bfd3-a54558711100 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-changed-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:38:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-9a69a03f-0190-4459-88d7-deec2419df20 req-26fb7886-5a6c-4c27-bfd3-a54558711100 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Refreshing instance network info cache due to event network-changed-4f15c60a-7230-4011-9f93-15cf877d4bb9. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:38:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9a69a03f-0190-4459-88d7-deec2419df20 req-26fb7886-5a6c-4c27-bfd3-a54558711100 service nova] Acquiring lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.network.neutron [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updating instance_info_cache with network_info: [{"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Releasing lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:38:28 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Creating image(s)
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Did not create local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Ensure instance console log exists: /opt/stack/data/nova/instances/87762694-f7bc-44b4-a37b-7f9e11fdd627/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Start _get_guest_xml network_info=[{"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvXdJlwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87762694-f7bc-44b4-a37b-7f9e11fdd627', 'attached_at': '', 'detached_at': '', 'volume_id': 'acf4e063-0578-4e92-88ad-c7a8e4bf9679', 'serial': 'acf4e063-0578-4e92-88ad-c7a8e4bf9679'}, 'attachment_id': '14108dac-afa7-4b94-9a17-3cd9d4d434d1', 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9a69a03f-0190-4459-88d7-deec2419df20 req-26fb7886-5a6c-4c27-bfd3-a54558711100 service nova] Acquired lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.network.neutron [req-9a69a03f-0190-4459-88d7-deec2419df20 req-26fb7886-5a6c-4c27-bfd3-a54558711100 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Refreshing network info cache for port 4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:38:28 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:38:28 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.objects.instance [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lazy-loading 'vcpu_model' on Instance uuid 87762694-f7bc-44b4-a37b-7f9e11fdd627 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvXdJlwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:38:28 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:38:28 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:38:28 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaee56c-d78c-451b-ab47-762f35d49f91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:38:28 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98623b5-d7a5-4988-aabf-ee5c3a4a5b00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679] added
Aug 16 12:38:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c83c8e-0929-466d-a404-8c28b792bc2c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed18fb8-afb2-4689-a745-958ff66a6dce]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvXdJlwW {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvXdJlwW" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afbc262-36e5-40dc-a5fc-6d357b5fd97d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YvXdJlwW'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf7a9cd-cab0-4d70-8bf0-ac8d6881fcd8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad417da0-efc1-44ac-83f2-4ecc4711bb48]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:38:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:38:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef44c09-1ab0-4896-a233-ec8d81405971]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260]
Aug 16 12:38:28 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260] successful.
Aug 16 12:38:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb84290a-335a-4bdb-8781-80217ca5b021]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67275b9-54c6-487c-8c14-9957728e766a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:38:28 user nova-compute[73520]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:38:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:38:28 user nova-compute[73520]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:38:28 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7194a47d-cbda-4af1-ba7e-52e8c906e543]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvXdJlwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.network.neutron [req-9a69a03f-0190-4459-88d7-deec2419df20 req-26fb7886-5a6c-4c27-bfd3-a54558711100 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updated VIF entry in instance network info cache for port 4f15c60a-7230-4011-9f93-15cf877d4bb9. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG nova.network.neutron [req-9a69a03f-0190-4459-88d7-deec2419df20 req-26fb7886-5a6c-4c27-bfd3-a54558711100 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updating instance_info_cache with network_info: [{"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:38:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9a69a03f-0190-4459-88d7-deec2419df20 req-26fb7886-5a6c-4c27-bfd3-a54558711100 service nova] Releasing lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26138656433653833', 'path': '/dev/sdc'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138656433653833', 'path': '/dev/sdc'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1762968804',display_name='tempest-TestShelveInstance-server-1762968804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1762968804',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1599693803',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:34:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='af7f1193dcd3415ca0e442cf073c7d92',ramdisk_id='',reservation_id='r-zrcwdju7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1971700305',owner_user_name='tempest-TestShelveInstance-1971700305-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:38:16Z,user_data=None,user_id='8dad9f2c3d7141c884f25d5e9a36f240',uuid=87762694-f7bc-44b4-a37b-7f9e11fdd627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Converting VIF {"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG nova.objects.instance [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lazy-loading 'pci_devices' on Instance uuid 87762694-f7bc-44b4-a37b-7f9e11fdd627 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:38:29 user nova-compute[73520]:   <uuid>87762694-f7bc-44b4-a37b-7f9e11fdd627</uuid>
Aug 16 12:38:29 user nova-compute[73520]:   <name>instance-0000002c</name>
Aug 16 12:38:29 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:38:29 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:38:29 user nova-compute[73520]:   <metadata>
Aug 16 12:38:29 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:38:29 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:38:29 user nova-compute[73520]:       <nova:name>tempest-TestShelveInstance-server-1762968804</nova:name>
Aug 16 12:38:29 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:38:28</nova:creationTime>
Aug 16 12:38:29 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:38:29 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:38:29 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:38:29 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:38:29 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:38:29 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:38:29 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:38:29 user nova-compute[73520]:       <nova:owner>
Aug 16 12:38:29 user nova-compute[73520]:         <nova:user uuid="8dad9f2c3d7141c884f25d5e9a36f240">tempest-TestShelveInstance-1971700305-project-member</nova:user>
Aug 16 12:38:29 user nova-compute[73520]:         <nova:project uuid="af7f1193dcd3415ca0e442cf073c7d92">tempest-TestShelveInstance-1971700305</nova:project>
Aug 16 12:38:29 user nova-compute[73520]:       </nova:owner>
Aug 16 12:38:29 user nova-compute[73520]:       <nova:ports>
Aug 16 12:38:29 user nova-compute[73520]:         <nova:port uuid="4f15c60a-7230-4011-9f93-15cf877d4bb9">
Aug 16 12:38:29 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 12:38:29 user nova-compute[73520]:         </nova:port>
Aug 16 12:38:29 user nova-compute[73520]:       </nova:ports>
Aug 16 12:38:29 user nova-compute[73520]:     </nova:instance>
Aug 16 12:38:29 user nova-compute[73520]:   </metadata>
Aug 16 12:38:29 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:38:29 user nova-compute[73520]:     <system>
Aug 16 12:38:29 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:38:29 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:38:29 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:38:29 user nova-compute[73520]:       <entry name="serial">87762694-f7bc-44b4-a37b-7f9e11fdd627</entry>
Aug 16 12:38:29 user nova-compute[73520]:       <entry name="uuid">87762694-f7bc-44b4-a37b-7f9e11fdd627</entry>
Aug 16 12:38:29 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:38:29 user nova-compute[73520]:     </system>
Aug 16 12:38:29 user nova-compute[73520]:   </sysinfo>
Aug 16 12:38:29 user nova-compute[73520]:   <os>
Aug 16 12:38:29 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:38:29 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:38:29 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:38:29 user nova-compute[73520]:   </os>
Aug 16 12:38:29 user nova-compute[73520]:   <features>
Aug 16 12:38:29 user nova-compute[73520]:     <acpi/>
Aug 16 12:38:29 user nova-compute[73520]:     <apic/>
Aug 16 12:38:29 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:38:29 user nova-compute[73520]:   </features>
Aug 16 12:38:29 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:38:29 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:38:29 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:38:29 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:38:29 user nova-compute[73520]:   </clock>
Aug 16 12:38:29 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:38:29 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:38:29 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:38:29 user nova-compute[73520]:   </cpu>
Aug 16 12:38:29 user nova-compute[73520]:   <devices>
Aug 16 12:38:29 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:38:29 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:38:29 user nova-compute[73520]:       <source dev="/dev/sdc"/>
Aug 16 12:38:29 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:38:29 user nova-compute[73520]:       <serial>acf4e063-0578-4e92-88ad-c7a8e4bf9679</serial>
Aug 16 12:38:29 user nova-compute[73520]:     </disk>
Aug 16 12:38:29 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:38:29 user nova-compute[73520]:       <mac address="fa:16:3e:a0:5c:00"/>
Aug 16 12:38:29 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:38:29 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:38:29 user nova-compute[73520]:       <target dev="tap4f15c60a-72"/>
Aug 16 12:38:29 user nova-compute[73520]:     </interface>
Aug 16 12:38:29 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:38:29 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/87762694-f7bc-44b4-a37b-7f9e11fdd627/console.log" append="off"/>
Aug 16 12:38:29 user nova-compute[73520]:     </serial>
Aug 16 12:38:29 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:38:29 user nova-compute[73520]:     <video>
Aug 16 12:38:29 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:38:29 user nova-compute[73520]:     </video>
Aug 16 12:38:29 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:38:29 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:38:29 user nova-compute[73520]:     </rng>
Aug 16 12:38:29 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:38:29 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:38:29 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:38:29 user nova-compute[73520]:     </memballoon>
Aug 16 12:38:29 user nova-compute[73520]:   </devices>
Aug 16 12:38:29 user nova-compute[73520]: </domain>
Aug 16 12:38:29 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1762968804',display_name='tempest-TestShelveInstance-server-1762968804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1762968804',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1599693803',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:34:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='af7f1193dcd3415ca0e442cf073c7d92',ramdisk_id='',reservation_id='r-zrcwdju7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1971700305',owner_user_name='tempest-TestShelveInstance-1971700305-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:38:16Z,user_data=None,user_id='8dad9f2c3d7141c884f25d5e9a36f240',uuid=87762694-f7bc-44b4-a37b-7f9e11fdd627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Converting VIF {"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG os_vif [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f15c60a-72, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f15c60a-72, col_values=(('external_ids', {'iface-id': '4f15c60a-7230-4011-9f93-15cf877d4bb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:5c:00', 'vm-uuid': '87762694-f7bc-44b4-a37b-7f9e11fdd627'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:29 user nova-compute[73520]: INFO os_vif [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72')
Aug 16 12:38:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:38:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] No VIF found with MAC fa:16:3e:a0:5c:00, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:38:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-46f8e545-3948-4e59-a5b6-5c93d6a0ae11 req-40604da5-b834-47be-8d01-683a89c0c0a3 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:38:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-46f8e545-3948-4e59-a5b6-5c93d6a0ae11 req-40604da5-b834-47be-8d01-683a89c0c0a3 service nova] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-46f8e545-3948-4e59-a5b6-5c93d6a0ae11 req-40604da5-b834-47be-8d01-683a89c0c0a3 service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-46f8e545-3948-4e59-a5b6-5c93d6a0ae11 req-40604da5-b834-47be-8d01-683a89c0c0a3 service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-46f8e545-3948-4e59-a5b6-5c93d6a0ae11 req-40604da5-b834-47be-8d01-683a89c0c0a3 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] No waiting events found dispatching network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:38:31 user nova-compute[73520]: WARNING nova.compute.manager [req-46f8e545-3948-4e59-a5b6-5c93d6a0ae11 req-40604da5-b834-47be-8d01-683a89c0c0a3 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received unexpected event network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 12:38:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:33 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189513.0909746, 87762694-f7bc-44b4-a37b-7f9e11fdd627 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:38:33 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] VM Resumed (Lifecycle Event)
Aug 16 12:38:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:38:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:38:33 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Instance spawned successfully.
Aug 16 12:38:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:38:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:38:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-288d54dc-171a-46be-8a88-7d8dcf2a21de req-0ee44d4b-e8b1-49ea-b1d1-7e3683deed9a service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:38:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-288d54dc-171a-46be-8a88-7d8dcf2a21de req-0ee44d4b-e8b1-49ea-b1d1-7e3683deed9a service nova] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-288d54dc-171a-46be-8a88-7d8dcf2a21de req-0ee44d4b-e8b1-49ea-b1d1-7e3683deed9a service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-288d54dc-171a-46be-8a88-7d8dcf2a21de req-0ee44d4b-e8b1-49ea-b1d1-7e3683deed9a service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-288d54dc-171a-46be-8a88-7d8dcf2a21de req-0ee44d4b-e8b1-49ea-b1d1-7e3683deed9a service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] No waiting events found dispatching network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:38:33 user nova-compute[73520]: WARNING nova.compute.manager [req-288d54dc-171a-46be-8a88-7d8dcf2a21de req-0ee44d4b-e8b1-49ea-b1d1-7e3683deed9a service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received unexpected event network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 12:38:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:38:33 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:38:33 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189513.0921936, 87762694-f7bc-44b4-a37b-7f9e11fdd627 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:38:33 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] VM Started (Lifecycle Event)
Aug 16 12:38:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:38:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-48536b12-058c-41b9-a3bc-2297891e4626 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.645s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:33 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:38:34 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189499.5429516, 14e89425-93b9-4005-bee2-2b7cc871ee13 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:38:34 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] VM Stopped (Lifecycle Event)
Aug 16 12:38:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-ba4f744e-48c4-47f6-a8b4-ae5d0643fc54 None None] [instance: 14e89425-93b9-4005-bee2-2b7cc871ee13] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:38:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:38:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:38:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:38:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:38:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:38:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:38:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:46 user nova-compute[73520]: INFO nova.compute.manager [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Terminating instance
Aug 16 12:38:46 user nova-compute[73520]: DEBUG nova.compute.manager [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:38:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:38:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:38:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:38:46 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d120ffa-4be5-4021-84d7-c0860154633b req-ac5b31e6-ecfb-4fd3-b07f-747aec075e2e service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-unplugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d120ffa-4be5-4021-84d7-c0860154633b req-ac5b31e6-ecfb-4fd3-b07f-747aec075e2e service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d120ffa-4be5-4021-84d7-c0860154633b req-ac5b31e6-ecfb-4fd3-b07f-747aec075e2e service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-9d120ffa-4be5-4021-84d7-c0860154633b req-ac5b31e6-ecfb-4fd3-b07f-747aec075e2e service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d120ffa-4be5-4021-84d7-c0860154633b req-ac5b31e6-ecfb-4fd3-b07f-747aec075e2e service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-unplugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG nova.compute.manager [req-9d120ffa-4be5-4021-84d7-c0860154633b req-ac5b31e6-ecfb-4fd3-b07f-747aec075e2e service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-unplugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:38:47 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Instance destroyed successfully.
Aug 16 12:38:47 user nova-compute[73520]: DEBUG nova.objects.instance [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lazy-loading 'resources' on Instance uuid 6ed1c5ac-d727-4157-a294-55b49ed26eea {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-725496249',display_name='tempest-ServerRescueNegativeTestJSON-server-725496249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-725496249',id=25,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:26:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='930fb7964e2942c88c3416be172c6884',ramdisk_id='',reservation_id='r-9dpq0ryk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-863509458',owner_user_name='tempest-ServerRescueNegativeTestJSON-863509458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:28:16Z,user_data=None,user_id='0d351d0adad3463ebb2e6917a5f91920',uuid=6ed1c5ac-d727-4157-a294-55b49ed26eea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converting VIF {"id": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "address": "fa:16:3e:98:9d:d6", "network": {"id": "6fc9b487-3bbb-4903-bd26-a602ad750dc5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1819757276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "930fb7964e2942c88c3416be172c6884", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381ef78-e5", "ovs_interfaceid": "b381ef78-e52f-4f08-a65e-c3b33ac5b5a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=b381ef78-e52f-4f08-a65e-c3b33ac5b5a2,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381ef78-e5') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG os_vif [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=b381ef78-e52f-4f08-a65e-c3b33ac5b5a2,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381ef78-e5') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb381ef78-e5, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:38:47 user nova-compute[73520]: INFO os_vif [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9d:d6,bridge_name='br-int',has_traffic_filtering=True,id=b381ef78-e52f-4f08-a65e-c3b33ac5b5a2,network=Network(6fc9b487-3bbb-4903-bd26-a602ad750dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381ef78-e5')
Aug 16 12:38:47 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Deleting instance files /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea_del
Aug 16 12:38:47 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Deletion of /opt/stack/data/nova/instances/6ed1c5ac-d727-4157-a294-55b49ed26eea_del complete
Aug 16 12:38:47 user nova-compute[73520]: INFO nova.compute.manager [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 16 12:38:47 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:38:47 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:38:48 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:38:48 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Took 0.58 seconds to deallocate network for instance.
Aug 16 12:38:48 user nova-compute[73520]: DEBUG nova.compute.manager [req-48fec6a4-ddef-48fa-b0a3-b9b6fd55f87f req-90ad91d4-b85a-420e-8fe2-44ba018a6ff3 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-deleted-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:38:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:48 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:38:48 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:38:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:48 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Deleted allocations for instance 6ed1c5ac-d727-4157-a294-55b49ed26eea
Aug 16 12:38:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-5d9f7759-361e-45af-a33b-660d81c8f2e2 tempest-ServerRescueNegativeTestJSON-863509458 tempest-ServerRescueNegativeTestJSON-863509458-project-member] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.650s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:49 user nova-compute[73520]: DEBUG nova.compute.manager [req-60272731-420a-412e-88fb-95d4c390096c req-38004337-ec64-4cd1-8064-fa78cf323615 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:38:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-60272731-420a-412e-88fb-95d4c390096c req-38004337-ec64-4cd1-8064-fa78cf323615 service nova] Acquiring lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-60272731-420a-412e-88fb-95d4c390096c req-38004337-ec64-4cd1-8064-fa78cf323615 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-60272731-420a-412e-88fb-95d4c390096c req-38004337-ec64-4cd1-8064-fa78cf323615 service nova] Lock "6ed1c5ac-d727-4157-a294-55b49ed26eea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:49 user nova-compute[73520]: DEBUG nova.compute.manager [req-60272731-420a-412e-88fb-95d4c390096c req-38004337-ec64-4cd1-8064-fa78cf323615 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] No waiting events found dispatching network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:38:49 user nova-compute[73520]: WARNING nova.compute.manager [req-60272731-420a-412e-88fb-95d4c390096c req-38004337-ec64-4cd1-8064-fa78cf323615 service nova] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Received unexpected event network-vif-plugged-b381ef78-e52f-4f08-a65e-c3b33ac5b5a2 for instance with vm_state deleted and task_state None.
Aug 16 12:38:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:38:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:50 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:38:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:38:55 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:38:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:55 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:38:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:38:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:38:57 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:38:57 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8319MB free_disk=25.351848602294922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 26b0286b-9021-4859-88ac-760e7249a3d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d034d519-491c-4963-95b1-48eaf2d81653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 87762694-f7bc-44b4-a37b-7f9e11fdd627 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing inventories for resource provider 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating ProviderTree inventory for provider 70dde5f5-9594-47c3-954e-598dd3089747 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing aggregate associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, aggregates: None {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing trait associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:38:57 user nova-compute[73520]: INFO nova.compute.manager [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Detaching volume f400539b-2944-4af4-b254-9ec43bfd6057
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:38:57 user nova-compute[73520]: INFO nova.virt.block_device [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Attempting to driver detach volume f400539b-2944-4af4-b254-9ec43bfd6057 from mountpoint /dev/vdb
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Attempting to detach device vdb from instance 26b0286b-9021-4859-88ac-760e7249a3d2 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:38:57 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:38:57 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:38:57 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:38:57 user nova-compute[73520]:   <serial>f400539b-2944-4af4-b254-9ec43bfd6057</serial>
Aug 16 12:38:57 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 12:38:57 user nova-compute[73520]: </disk>
Aug 16 12:38:57 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:38:57 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully detached device vdb from instance 26b0286b-9021-4859-88ac-760e7249a3d2 from the persistent domain config.
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 26b0286b-9021-4859-88ac-760e7249a3d2 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:38:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:38:57 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:38:57 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:38:57 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:38:57 user nova-compute[73520]:   <serial>f400539b-2944-4af4-b254-9ec43bfd6057</serial>
Aug 16 12:38:57 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 12:38:57 user nova-compute[73520]: </disk>
Aug 16 12:38:57 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692189538.4972985, 26b0286b-9021-4859-88ac-760e7249a3d2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:38:58 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully detached device vdb from instance 26b0286b-9021-4859-88ac-760e7249a3d2 from the live domain config.
Aug 16 12:38:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJBPsaTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:38:58 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a7d482-62ab-4399-95a3-ea6ccf3040d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c75a64-1d13-4954-b7ff-4456cfb9e07e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:38:58 user nova-compute[73520]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:38:58 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 (non-flash)
Aug 16 12:38:58 user nova-compute[73520]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:38:58 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c693f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d82f41e-e105-4944-b675-8f32a8bd7147]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a4af55-7aa6-4ec2-ba63-64a27a2d8d72]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d2567a-6a0e-4eab-9d5e-d6aa496a5205]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfdb4a4-f937-483c-bcbb-a1ad8cc8a846]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af55cd8-b88b-4fb6-b4c8-ed3c04cee52c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[18031adb-368a-4afb-b4a9-eb80444232fe]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260]
Aug 16 12:38:58 user nova-compute[73520]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057, portal: 172.16.0.220,3260] successful.
Aug 16 12:38:58 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f400539b-2944-4af4-b254-9ec43bfd6057 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e590aad-051c-4721-8a6f-54f9a54e5d82]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] <== disconnect_volume: return (291ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:38:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:38:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:38:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:38:59 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:38:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:38:59 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updating instance_info_cache with network_info: [{"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:38:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:38:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:38:59 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:38:59 user nova-compute[73520]: DEBUG nova.objects.instance [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'flavor' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:38:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-71b19fdc-e190-494a-b2ae-c4634cfdc680 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.840s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-069d9c55-af95-488e-8737-04f57a041489 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-069d9c55-af95-488e-8737-04f57a041489 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-069d9c55-af95-488e-8737-04f57a041489 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-069d9c55-af95-488e-8737-04f57a041489 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73520) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG nova.objects.instance [None req-069d9c55-af95-488e-8737-04f57a041489 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'flavor' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-8f3c3eff-ea18-4ca2-8b78-d474e4bab2a1 req-ef7b1195-1709-4873-954a-07d15ee70854 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-unplugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8f3c3eff-ea18-4ca2-8b78-d474e4bab2a1 req-ef7b1195-1709-4873-954a-07d15ee70854 service nova] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8f3c3eff-ea18-4ca2-8b78-d474e4bab2a1 req-ef7b1195-1709-4873-954a-07d15ee70854 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8f3c3eff-ea18-4ca2-8b78-d474e4bab2a1 req-ef7b1195-1709-4873-954a-07d15ee70854 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:39:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-8f3c3eff-ea18-4ca2-8b78-d474e4bab2a1 req-ef7b1195-1709-4873-954a-07d15ee70854 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] No waiting events found dispatching network-vif-unplugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:39:00 user nova-compute[73520]: WARNING nova.compute.manager [req-8f3c3eff-ea18-4ca2-8b78-d474e4bab2a1 req-ef7b1195-1709-4873-954a-07d15ee70854 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received unexpected event network-vif-unplugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f for instance with vm_state active and task_state powering-off.
Aug 16 12:39:00 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Instance destroyed successfully.
Aug 16 12:39:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-069d9c55-af95-488e-8737-04f57a041489 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:39:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-069d9c55-af95-488e-8737-04f57a041489 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.846s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:39:01 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:39:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 12:39:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] There are 0 instances to clean {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 12:39:02 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189527.3438284, 6ed1c5ac-d727-4157-a294-55b49ed26eea => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:39:02 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] VM Stopped (Lifecycle Event)
Aug 16 12:39:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-26aa5f00-0216-4c06-ba6d-0b333735f90c None None] [instance: 6ed1c5ac-d727-4157-a294-55b49ed26eea] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:39:02 user nova-compute[73520]: DEBUG nova.compute.manager [req-96a1af3f-0c10-4f58-b199-2f277e51fc7d req-a5d3b5ee-9e1b-47e6-9df8-88a57442277e service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:39:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-96a1af3f-0c10-4f58-b199-2f277e51fc7d req-a5d3b5ee-9e1b-47e6-9df8-88a57442277e service nova] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:39:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-96a1af3f-0c10-4f58-b199-2f277e51fc7d req-a5d3b5ee-9e1b-47e6-9df8-88a57442277e service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:39:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-96a1af3f-0c10-4f58-b199-2f277e51fc7d req-a5d3b5ee-9e1b-47e6-9df8-88a57442277e service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:39:02 user nova-compute[73520]: DEBUG nova.compute.manager [req-96a1af3f-0c10-4f58-b199-2f277e51fc7d req-a5d3b5ee-9e1b-47e6-9df8-88a57442277e service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] No waiting events found dispatching network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:39:02 user nova-compute[73520]: WARNING nova.compute.manager [req-96a1af3f-0c10-4f58-b199-2f277e51fc7d req-a5d3b5ee-9e1b-47e6-9df8-88a57442277e service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received unexpected event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f for instance with vm_state stopped and task_state None.
Aug 16 12:39:02 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:39:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:39:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 12:39:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:39:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:39:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:39:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:39:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:39:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:15 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189540.9684734, 26b0286b-9021-4859-88ac-760e7249a3d2 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:39:15 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] VM Stopped (Lifecycle Event)
Aug 16 12:39:15 user nova-compute[73520]: DEBUG nova.compute.manager [None req-8b60f72e-3154-459e-8a8c-29c7e1968c80 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:39:15 user nova-compute[73520]: DEBUG nova.compute.manager [None req-8b60f72e-3154-459e-8a8c-29c7e1968c80 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:39:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-5b91d064-5b14-44fa-af08-bc3332db04c6 req-843996d9-1cf5-4440-8348-b3f566d670a6 service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Received event network-changed-63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:39:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-5b91d064-5b14-44fa-af08-bc3332db04c6 req-843996d9-1cf5-4440-8348-b3f566d670a6 service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Refreshing instance network info cache due to event network-changed-63a2fe18-23e4-4eaa-9a52-aab734ec0bec. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:39:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5b91d064-5b14-44fa-af08-bc3332db04c6 req-843996d9-1cf5-4440-8348-b3f566d670a6 service nova] Acquiring lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:39:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5b91d064-5b14-44fa-af08-bc3332db04c6 req-843996d9-1cf5-4440-8348-b3f566d670a6 service nova] Acquired lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:39:16 user nova-compute[73520]: DEBUG nova.network.neutron [req-5b91d064-5b14-44fa-af08-bc3332db04c6 req-843996d9-1cf5-4440-8348-b3f566d670a6 service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Refreshing network info cache for port 63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:39:17 user nova-compute[73520]: DEBUG nova.network.neutron [req-5b91d064-5b14-44fa-af08-bc3332db04c6 req-843996d9-1cf5-4440-8348-b3f566d670a6 service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updated VIF entry in instance network info cache for port 63a2fe18-23e4-4eaa-9a52-aab734ec0bec. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:39:17 user nova-compute[73520]: DEBUG nova.network.neutron [req-5b91d064-5b14-44fa-af08-bc3332db04c6 req-843996d9-1cf5-4440-8348-b3f566d670a6 service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updating instance_info_cache with network_info: [{"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:39:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-5b91d064-5b14-44fa-af08-bc3332db04c6 req-843996d9-1cf5-4440-8348-b3f566d670a6 service nova] Releasing lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:39:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:18 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:39:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:39:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 87762694-f7bc-44b4-a37b-7f9e11fdd627 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:39:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:39:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:39:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:39:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:39:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:39:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:39:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:39:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:39:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:39:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:39:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'flavor' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:39:22 user nova-compute[73520]: INFO nova.compute.manager [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Attaching volume 1c852266-e79e-47ee-8e3f-08a902d15a19 to /dev/vdb
Aug 16 12:39:22 user nova-compute[73520]: DEBUG os_brick.utils [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ca62e7-abde-4737-a600-2a6424a50cda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad61bbd-5b30-4219-845e-264a09a6c432]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84e1db5-84fe-4efa-98de-e91127ac46e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef597b16-a24c-4f7e-8e43-2639861e08cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:39:22 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:39:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d428016-3924-42b7-b7fb-8f0cbcd47536]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG os_brick.utils [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:39:22 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updating existing volume attachment record: a1e69ca1-6eff-4b17-943e-ff92c1c2317c {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:39:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:39:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:39:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:39:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:39:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNZfpgTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:39:33 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:39:33 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:39:33 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b3d5a6-20af-45c5-9e0e-6d850e30ef91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:39:33 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c01ce52-5428-4bec-9184-7c98af5ecdba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19] added
Aug 16 12:39:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[978c80f5-4d02-4148-bbb5-a85e04b91b0f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5640150f-61e0-4a97-b801-3f93507e1697]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNZfpgTw {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNZfpgTw" returned: 0 in 0.038s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7791197f-251d-4eb0-8565-c31dc0c9e8de]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iNZfpgTw'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9255dd95-19fb-4e36-a909-061e99ab40fa]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f61117-8f7e-4931-882b-e911b0adafa0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:39:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:39:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de31982-e73a-40b8-b1b5-05ceca80597a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19, portal: 172.16.0.220,3260]
Aug 16 12:39:33 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19, portal: 172.16.0.220,3260] successful.
Aug 16 12:39:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[349bc078-e8be-47bb-8328-5d8207535e6e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c19f8e-5a15-45b8-83db-e63f991aa391]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:39:33 user nova-compute[73520]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 (non-flash)
Aug 16 12:39:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:39:33 user nova-compute[73520]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 (non-flash)
Aug 16 12:39:33 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:39:33 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[050b483f-1be0-4175-a2aa-ccd0e989b5e5]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:39:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:39:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNZfpgTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:39:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:35 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:39:35 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26364626330613164', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:39:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364626330613164', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:39:35 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'flavor' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:39:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:39:35 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:39:35 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:39:35 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:39:35 user nova-compute[73520]:   <serial>1c852266-e79e-47ee-8e3f-08a902d15a19</serial>
Aug 16 12:39:35 user nova-compute[73520]: </disk>
Aug 16 12:39:35 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:39:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:39:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:39:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No VIF found with MAC fa:16:3e:43:87:09, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:39:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d8b3a5e3-bfdc-42e0-ada0-b6fd436ed12c tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.857s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:39:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:39:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:39:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:39:46 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:39:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:39:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:39:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:39:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:39:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:47 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:39:47 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:39:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:50 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:39:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:39:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:39:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:39:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:39:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:39:56 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:39:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:39:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:39:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:39:57 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:39:58 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:39:58 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:39:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8485MB free_disk=25.33975601196289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:39:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:39:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:39:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 26b0286b-9021-4859-88ac-760e7249a3d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:39:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d034d519-491c-4963-95b1-48eaf2d81653 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:39:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 87762694-f7bc-44b4-a37b-7f9e11fdd627 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:39:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:39:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:39:58 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:39:58 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:39:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:39:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:39:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:39:59 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:39:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:39:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:39:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:39:59 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:40:00 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updating instance_info_cache with network_info: [{"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:40:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:40:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:40:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:40:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:40:05 user nova-compute[73520]: INFO nova.compute.manager [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Detaching volume 1c852266-e79e-47ee-8e3f-08a902d15a19
Aug 16 12:40:05 user nova-compute[73520]: INFO nova.virt.block_device [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Attempting to driver detach volume 1c852266-e79e-47ee-8e3f-08a902d15a19 from mountpoint /dev/vdb
Aug 16 12:40:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Attempting to detach device vdb from instance d034d519-491c-4963-95b1-48eaf2d81653 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:40:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:40:05 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:40:05 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:40:05 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:40:05 user nova-compute[73520]:   <serial>1c852266-e79e-47ee-8e3f-08a902d15a19</serial>
Aug 16 12:40:05 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:40:05 user nova-compute[73520]: </disk>
Aug 16 12:40:05 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:40:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Successfully detached device vdb from instance d034d519-491c-4963-95b1-48eaf2d81653 from the persistent domain config.
Aug 16 12:40:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d034d519-491c-4963-95b1-48eaf2d81653 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:40:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:40:05 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:40:05 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:40:05 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:40:05 user nova-compute[73520]:   <serial>1c852266-e79e-47ee-8e3f-08a902d15a19</serial>
Aug 16 12:40:05 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:40:05 user nova-compute[73520]: </disk>
Aug 16 12:40:05 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692189606.4417326, d034d519-491c-4963-95b1-48eaf2d81653 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:40:06 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Successfully detached device vdb from instance d034d519-491c-4963-95b1-48eaf2d81653 from the live domain config.
Aug 16 12:40:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNZfpgTw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:40:06 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[70453f21-dc8d-477f-b00a-56e97dbf301a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e537b0c0-7966-4471-830d-16e199a1d320]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:40:06 user nova-compute[73520]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 (non-flash)
Aug 16 12:40:06 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:40:06 user nova-compute[73520]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 (non-flash)
Aug 16 12:40:06 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c601000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e79f85-e942-4deb-bfb0-3158f9d410f1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[686fe625-e463-4e45-a0e7-66f3a4ef95fd]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d1f35d-f2f1-4693-b039-c89dcb7f236b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8653f3c-9c10-4f29-ab3a-66b263e4f130]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8166c259-28ce-4732-8084-91bbf00a20c1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb13b0ba-de13-453e-8297-4c83a90b000b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19, portal: 172.16.0.220,3260]
Aug 16 12:40:06 user nova-compute[73520]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19, portal: 172.16.0.220,3260] successful.
Aug 16 12:40:06 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c852266-e79e-47ee-8e3f-08a902d15a19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6b77af-ede1-464b-a2cd-292b49e05a34]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] <== disconnect_volume: return (305ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG nova.compute.manager [req-285b19bb-c783-416c-8db4-a7ebab6d4bf2 req-48b42f8c-061b-44b3-a289-975a9338d111 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-changed-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG nova.compute.manager [req-285b19bb-c783-416c-8db4-a7ebab6d4bf2 req-48b42f8c-061b-44b3-a289-975a9338d111 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Refreshing instance network info cache due to event network-changed-4f15c60a-7230-4011-9f93-15cf877d4bb9. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-285b19bb-c783-416c-8db4-a7ebab6d4bf2 req-48b42f8c-061b-44b3-a289-975a9338d111 service nova] Acquiring lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-285b19bb-c783-416c-8db4-a7ebab6d4bf2 req-48b42f8c-061b-44b3-a289-975a9338d111 service nova] Acquired lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:40:06 user nova-compute[73520]: DEBUG nova.network.neutron [req-285b19bb-c783-416c-8db4-a7ebab6d4bf2 req-48b42f8c-061b-44b3-a289-975a9338d111 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Refreshing network info cache for port 4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:40:07 user nova-compute[73520]: INFO nova.compute.manager [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Terminating instance
Aug 16 12:40:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG nova.network.neutron [req-285b19bb-c783-416c-8db4-a7ebab6d4bf2 req-48b42f8c-061b-44b3-a289-975a9338d111 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updated VIF entry in instance network info cache for port 4f15c60a-7230-4011-9f93-15cf877d4bb9. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG nova.network.neutron [req-285b19bb-c783-416c-8db4-a7ebab6d4bf2 req-48b42f8c-061b-44b3-a289-975a9338d111 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updating instance_info_cache with network_info: [{"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-285b19bb-c783-416c-8db4-a7ebab6d4bf2 req-48b42f8c-061b-44b3-a289-975a9338d111 service nova] Releasing lock "refresh_cache-87762694-f7bc-44b4-a37b-7f9e11fdd627" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG nova.objects.instance [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'flavor' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-574bc19f-da4b-48bc-a730-47bfc0288fbd tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.810s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-626bd12a-cc11-4773-a45b-41889db0db32 req-4c4644f0-0288-428f-a64a-c75b442da000 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-vif-unplugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-626bd12a-cc11-4773-a45b-41889db0db32 req-4c4644f0-0288-428f-a64a-c75b442da000 service nova] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-626bd12a-cc11-4773-a45b-41889db0db32 req-4c4644f0-0288-428f-a64a-c75b442da000 service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-626bd12a-cc11-4773-a45b-41889db0db32 req-4c4644f0-0288-428f-a64a-c75b442da000 service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-626bd12a-cc11-4773-a45b-41889db0db32 req-4c4644f0-0288-428f-a64a-c75b442da000 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] No waiting events found dispatching network-vif-unplugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-626bd12a-cc11-4773-a45b-41889db0db32 req-4c4644f0-0288-428f-a64a-c75b442da000 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-vif-unplugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:40:07 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Instance destroyed successfully.
Aug 16 12:40:07 user nova-compute[73520]: DEBUG nova.objects.instance [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lazy-loading 'resources' on Instance uuid 87762694-f7bc-44b4-a37b-7f9e11fdd627 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T12:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1762968804',display_name='tempest-TestShelveInstance-server-1762968804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1762968804',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0Yb5/yDtg/+xo5Xx2Aj8NIMdu6T6UP+UvyUgQRFiFrHQrxuwRb4TYEqIrdfN8knygXFvaDYnN6hJcknWDLd/V/82hafp7vrTaSbn8yS/kvOhfMvo4bViuQawj8E1al9w==',key_name='tempest-TestShelveInstance-1599693803',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:38:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af7f1193dcd3415ca0e442cf073c7d92',ramdisk_id='',reservation_id='r-zrcwdju7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1971700305',owner_user_name='tempest-TestShelveInstance-1971700305-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:38:33Z,user_data=None,user_id='8dad9f2c3d7141c884f25d5e9a36f240',uuid=87762694-f7bc-44b4-a37b-7f9e11fdd627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Converting VIF {"id": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "address": "fa:16:3e:a0:5c:00", "network": {"id": "fb539189-7910-480c-8819-9e934a7da697", "bridge": "br-int", "label": "tempest-TestShelveInstance-957483527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7f1193dcd3415ca0e442cf073c7d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f15c60a-72", "ovs_interfaceid": "4f15c60a-7230-4011-9f93-15cf877d4bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG os_vif [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f15c60a-72, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:07 user nova-compute[73520]: INFO os_vif [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:00,bridge_name='br-int',has_traffic_filtering=True,id=4f15c60a-7230-4011-9f93-15cf877d4bb9,network=Network(fb539189-7910-480c-8819-9e934a7da697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f15c60a-72')
Aug 16 12:40:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvXdJlwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:40:07 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:40:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:40:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced75ac5-6504-4c33-9abe-add6cc178bc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fca20a8-b1ba-476f-9add-ff29279e2ee9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:40:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 (non-flash)
Aug 16 12:40:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c121120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679'): ({'sdc'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Removing single pathed devices sdc {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad0d91d-b122-402e-acbc-376c1ded6edc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d76ee9c-07c7-4197-b5f6-31e8d1f2a2cf]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Flushing IO for device /dev/sdc {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1c0086-b57c-4282-b26c-715fef2cb8ce]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.095s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec62330-b6db-4e0e-9136-b2ae33af95b6]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e4a9f0-586b-4478-862c-13897a776db2]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[75042de2-c365-49fe-8d52-5275076f9dad]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260]
Aug 16 12:40:08 user nova-compute[73520]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679, portal: 172.16.0.220,3260] successful.
Aug 16 12:40:08 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf4e063-0578-4e92-88ad-c7a8e4bf9679 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0a28d0-5ad0-4de0-a820-e2cdda6b1565]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] <== disconnect_volume: return (401ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:40:08 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Deleting instance files /opt/stack/data/nova/instances/87762694-f7bc-44b4-a37b-7f9e11fdd627_del
Aug 16 12:40:08 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Deletion of /opt/stack/data/nova/instances/87762694-f7bc-44b4-a37b-7f9e11fdd627_del complete
Aug 16 12:40:08 user nova-compute[73520]: INFO nova.compute.manager [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Took 1.42 seconds to destroy the instance on the hypervisor.
Aug 16 12:40:08 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:40:08 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:40:09 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:40:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-10de578e-a6ac-4f7e-8635-bff2267032b6 req-06ed23ff-7d69-4687-a482-a35ee36745e6 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-vif-deleted-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:40:09 user nova-compute[73520]: INFO nova.compute.manager [req-10de578e-a6ac-4f7e-8635-bff2267032b6 req-06ed23ff-7d69-4687-a482-a35ee36745e6 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Neutron deleted interface 4f15c60a-7230-4011-9f93-15cf877d4bb9; detaching it from the instance and deleting it from the info cache
Aug 16 12:40:09 user nova-compute[73520]: DEBUG nova.network.neutron [req-10de578e-a6ac-4f7e-8635-bff2267032b6 req-06ed23ff-7d69-4687-a482-a35ee36745e6 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:40:09 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Took 0.79 seconds to deallocate network for instance.
Aug 16 12:40:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-10de578e-a6ac-4f7e-8635-bff2267032b6 req-06ed23ff-7d69-4687-a482-a35ee36745e6 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Detach interface failed, port_id=4f15c60a-7230-4011-9f93-15cf877d4bb9, reason: Instance 87762694-f7bc-44b4-a37b-7f9e11fdd627 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:40:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-4e966a4d-30e7-45d5-b053-64140a4dfddb req-e8688a4d-169b-4f56-83c2-49e87efadb79 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received event network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:40:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4e966a4d-30e7-45d5-b053-64140a4dfddb req-e8688a4d-169b-4f56-83c2-49e87efadb79 service nova] Acquiring lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:40:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4e966a4d-30e7-45d5-b053-64140a4dfddb req-e8688a4d-169b-4f56-83c2-49e87efadb79 service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:40:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4e966a4d-30e7-45d5-b053-64140a4dfddb req-e8688a4d-169b-4f56-83c2-49e87efadb79 service nova] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:40:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-4e966a4d-30e7-45d5-b053-64140a4dfddb req-e8688a4d-169b-4f56-83c2-49e87efadb79 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] No waiting events found dispatching network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:40:10 user nova-compute[73520]: WARNING nova.compute.manager [req-4e966a4d-30e7-45d5-b053-64140a4dfddb req-e8688a4d-169b-4f56-83c2-49e87efadb79 service nova] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Received unexpected event network-vif-plugged-4f15c60a-7230-4011-9f93-15cf877d4bb9 for instance with vm_state active and task_state deleting.
Aug 16 12:40:10 user nova-compute[73520]: INFO nova.compute.manager [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Took 0.79 seconds to detach 1 volumes for instance.
Aug 16 12:40:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Deleting volume: acf4e063-0578-4e92-88ad-c7a8e4bf9679 {{(pid=73520) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 12:40:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:40:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:40:10 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:40:10 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:40:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:40:10 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Deleted allocations for instance 87762694-f7bc-44b4-a37b-7f9e11fdd627
Aug 16 12:40:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-40271600-2b03-4001-bcbd-4a8c802bbbf5 tempest-TestShelveInstance-1971700305 tempest-TestShelveInstance-1971700305-project-member] Lock "87762694-f7bc-44b4-a37b-7f9e11fdd627" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.563s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:40:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:22 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189607.9039056, 87762694-f7bc-44b4-a37b-7f9e11fdd627 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:40:22 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] VM Stopped (Lifecycle Event)
Aug 16 12:40:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c492809d-a60c-4c27-9a21-3d63783ff374 None None] [instance: 87762694-f7bc-44b4-a37b-7f9e11fdd627] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:40:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:46 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:40:47 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:40:47 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:40:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:40:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:40:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:40:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:40:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:40:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:40:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:40:50 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.objects.instance [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'flavor' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquired lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.objects.instance [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'info_cache' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.network.neutron [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updating instance_info_cache with network_info: [{"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Releasing lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:40:51 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Instance destroyed successfully.
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.objects.instance [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'resources' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1747553426',display_name='tempest-AttachVolumeTestJSON-server-1747553426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1747553426',id=42,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF2K5lPCqq45wlqWBJxOjnJMaqjiorbGycI/+zIIrQyDX2lqhtiNH0sOEH1miqoWIiFDFfI+JbhEvZIwSQ6ThAdNXntyvNLGxVlW0nvg7ZrlFK5UVMdROmd3/SoB5yrFw==',key_name='tempest-keypair-1911074579',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='446e9796da1f4303bb7d628fa8c8c3c3',ramdisk_id='',reservation_id='r-0o6wl00i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1174912644',owner_user_name='tempest-AttachVolumeTestJSON-1174912644-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:39:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9ef4b48f36408eba035f0d7e277dcb',uuid=26b0286b-9021-4859-88ac-760e7249a3d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converting VIF {"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG os_vif [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e7cef18-ea, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:40:51 user nova-compute[73520]: INFO os_vif [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea')
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Start _get_guest_xml network_info=[{"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.objects.instance [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'numa_topology' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:40:51 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:40:51 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.objects.instance [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'vcpu_model' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1747553426',display_name='tempest-AttachVolumeTestJSON-server-1747553426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1747553426',id=42,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF2K5lPCqq45wlqWBJxOjnJMaqjiorbGycI/+zIIrQyDX2lqhtiNH0sOEH1miqoWIiFDFfI+JbhEvZIwSQ6ThAdNXntyvNLGxVlW0nvg7ZrlFK5UVMdROmd3/SoB5yrFw==',key_name='tempest-keypair-1911074579',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='446e9796da1f4303bb7d628fa8c8c3c3',ramdisk_id='',reservation_id='r-0o6wl00i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1174912644',owner_user_name='tempest-AttachVolumeTestJSON-1174912644-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:39:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9ef4b48f36408eba035f0d7e277dcb',uuid=26b0286b-9021-4859-88ac-760e7249a3d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converting VIF {"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.objects.instance [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'pci_devices' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:40:51 user nova-compute[73520]:   <uuid>26b0286b-9021-4859-88ac-760e7249a3d2</uuid>
Aug 16 12:40:51 user nova-compute[73520]:   <name>instance-0000002a</name>
Aug 16 12:40:51 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:40:51 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:40:51 user nova-compute[73520]:   <metadata>
Aug 16 12:40:51 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:40:51 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:40:51 user nova-compute[73520]:       <nova:name>tempest-AttachVolumeTestJSON-server-1747553426</nova:name>
Aug 16 12:40:51 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:40:51</nova:creationTime>
Aug 16 12:40:51 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:40:51 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:40:51 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:40:51 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:40:51 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:40:51 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:40:51 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:40:51 user nova-compute[73520]:       <nova:owner>
Aug 16 12:40:51 user nova-compute[73520]:         <nova:user uuid="df9ef4b48f36408eba035f0d7e277dcb">tempest-AttachVolumeTestJSON-1174912644-project-member</nova:user>
Aug 16 12:40:51 user nova-compute[73520]:         <nova:project uuid="446e9796da1f4303bb7d628fa8c8c3c3">tempest-AttachVolumeTestJSON-1174912644</nova:project>
Aug 16 12:40:51 user nova-compute[73520]:       </nova:owner>
Aug 16 12:40:51 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:40:51 user nova-compute[73520]:       <nova:ports>
Aug 16 12:40:51 user nova-compute[73520]:         <nova:port uuid="6e7cef18-ea49-45cb-a7e8-3e5292b6f48f">
Aug 16 12:40:51 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 12:40:51 user nova-compute[73520]:         </nova:port>
Aug 16 12:40:51 user nova-compute[73520]:       </nova:ports>
Aug 16 12:40:51 user nova-compute[73520]:     </nova:instance>
Aug 16 12:40:51 user nova-compute[73520]:   </metadata>
Aug 16 12:40:51 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:40:51 user nova-compute[73520]:     <system>
Aug 16 12:40:51 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:40:51 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:40:51 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:40:51 user nova-compute[73520]:       <entry name="serial">26b0286b-9021-4859-88ac-760e7249a3d2</entry>
Aug 16 12:40:51 user nova-compute[73520]:       <entry name="uuid">26b0286b-9021-4859-88ac-760e7249a3d2</entry>
Aug 16 12:40:51 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:40:51 user nova-compute[73520]:     </system>
Aug 16 12:40:51 user nova-compute[73520]:   </sysinfo>
Aug 16 12:40:51 user nova-compute[73520]:   <os>
Aug 16 12:40:51 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:40:51 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:40:51 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:40:51 user nova-compute[73520]:   </os>
Aug 16 12:40:51 user nova-compute[73520]:   <features>
Aug 16 12:40:51 user nova-compute[73520]:     <acpi/>
Aug 16 12:40:51 user nova-compute[73520]:     <apic/>
Aug 16 12:40:51 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:40:51 user nova-compute[73520]:   </features>
Aug 16 12:40:51 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:40:51 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:40:51 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:40:51 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:40:51 user nova-compute[73520]:   </clock>
Aug 16 12:40:51 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:40:51 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:40:51 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:40:51 user nova-compute[73520]:   </cpu>
Aug 16 12:40:51 user nova-compute[73520]:   <devices>
Aug 16 12:40:51 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:40:51 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:40:51 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk"/>
Aug 16 12:40:51 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:40:51 user nova-compute[73520]:     </disk>
Aug 16 12:40:51 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:40:51 user nova-compute[73520]:       <mac address="fa:16:3e:25:5f:15"/>
Aug 16 12:40:51 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:40:51 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:40:51 user nova-compute[73520]:       <target dev="tap6e7cef18-ea"/>
Aug 16 12:40:51 user nova-compute[73520]:     </interface>
Aug 16 12:40:51 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:40:51 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/console.log" append="off"/>
Aug 16 12:40:51 user nova-compute[73520]:     </serial>
Aug 16 12:40:51 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:40:51 user nova-compute[73520]:     <video>
Aug 16 12:40:51 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:40:51 user nova-compute[73520]:     </video>
Aug 16 12:40:51 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:40:51 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:40:51 user nova-compute[73520]:     </rng>
Aug 16 12:40:51 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:40:51 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:40:51 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:40:51 user nova-compute[73520]:     </memballoon>
Aug 16 12:40:51 user nova-compute[73520]:   </devices>
Aug 16 12:40:51 user nova-compute[73520]: </domain>
Aug 16 12:40:51 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:40:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG nova.objects.instance [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'trusted_certs' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Cannot resize image /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG nova.objects.instance [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'migration_context' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1747553426',display_name='tempest-AttachVolumeTestJSON-server-1747553426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1747553426',id=42,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF2K5lPCqq45wlqWBJxOjnJMaqjiorbGycI/+zIIrQyDX2lqhtiNH0sOEH1miqoWIiFDFfI+JbhEvZIwSQ6ThAdNXntyvNLGxVlW0nvg7ZrlFK5UVMdROmd3/SoB5yrFw==',key_name='tempest-keypair-1911074579',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='446e9796da1f4303bb7d628fa8c8c3c3',ramdisk_id='',reservation_id='r-0o6wl00i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1174912644',owner_user_name='tempest-AttachVolumeTestJSON-1174912644-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:39:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9ef4b48f36408eba035f0d7e277dcb',uuid=26b0286b-9021-4859-88ac-760e7249a3d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converting VIF {"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG os_vif [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e7cef18-ea, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e7cef18-ea, col_values=(('external_ids', {'iface-id': '6e7cef18-ea49-45cb-a7e8-3e5292b6f48f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:5f:15', 'vm-uuid': '26b0286b-9021-4859-88ac-760e7249a3d2'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:40:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:52 user nova-compute[73520]: INFO os_vif [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea')
Aug 16 12:40:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-32049cc8-6d06-419e-bc8a-2c0654d676f9 req-59132f3d-2931-4e27-8892-5adf51485e4e service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:40:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32049cc8-6d06-419e-bc8a-2c0654d676f9 req-59132f3d-2931-4e27-8892-5adf51485e4e service nova] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:40:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32049cc8-6d06-419e-bc8a-2c0654d676f9 req-59132f3d-2931-4e27-8892-5adf51485e4e service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:40:54 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-32049cc8-6d06-419e-bc8a-2c0654d676f9 req-59132f3d-2931-4e27-8892-5adf51485e4e service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:40:54 user nova-compute[73520]: DEBUG nova.compute.manager [req-32049cc8-6d06-419e-bc8a-2c0654d676f9 req-59132f3d-2931-4e27-8892-5adf51485e4e service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] No waiting events found dispatching network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:40:54 user nova-compute[73520]: WARNING nova.compute.manager [req-32049cc8-6d06-419e-bc8a-2c0654d676f9 req-59132f3d-2931-4e27-8892-5adf51485e4e service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received unexpected event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f for instance with vm_state stopped and task_state powering-on.
Aug 16 12:40:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-ed6b78cd-1e5c-4807-b303-da8783de1fdd req-d8be6e77-4c0e-4968-aaf7-839962428eb3 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:40:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed6b78cd-1e5c-4807-b303-da8783de1fdd req-d8be6e77-4c0e-4968-aaf7-839962428eb3 service nova] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:40:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed6b78cd-1e5c-4807-b303-da8783de1fdd req-d8be6e77-4c0e-4968-aaf7-839962428eb3 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:40:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed6b78cd-1e5c-4807-b303-da8783de1fdd req-d8be6e77-4c0e-4968-aaf7-839962428eb3 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:40:56 user nova-compute[73520]: DEBUG nova.compute.manager [req-ed6b78cd-1e5c-4807-b303-da8783de1fdd req-d8be6e77-4c0e-4968-aaf7-839962428eb3 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] No waiting events found dispatching network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:40:56 user nova-compute[73520]: WARNING nova.compute.manager [req-ed6b78cd-1e5c-4807-b303-da8783de1fdd req-d8be6e77-4c0e-4968-aaf7-839962428eb3 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received unexpected event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f for instance with vm_state stopped and task_state powering-on.
Aug 16 12:40:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:40:56 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189656.4832072, 26b0286b-9021-4859-88ac-760e7249a3d2 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:40:56 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] VM Resumed (Lifecycle Event)
Aug 16 12:40:56 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Instance rebooted successfully.
Aug 16 12:40:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-cae6c744-b4f6-4942-8035-f5d3f34f1aa4 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:40:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:40:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:40:56 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 12:40:56 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189656.4834743, 26b0286b-9021-4859-88ac-760e7249a3d2 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:40:56 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] VM Started (Lifecycle Event)
Aug 16 12:40:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:40:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:40:56 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 12:40:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:40:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:40:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:40:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:40:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:40:58 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:40:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:40:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:40:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:40:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:00 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:41:00 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:41:00 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8539MB free_disk=25.32665252685547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:41:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:41:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:41:00 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 26b0286b-9021-4859-88ac-760e7249a3d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:41:00 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d034d519-491c-4963-95b1-48eaf2d81653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:41:00 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:41:00 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:41:00 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:41:00 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:41:00 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:41:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG nova.objects.instance [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'flavor' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:41:01 user nova-compute[73520]: INFO nova.compute.manager [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Attaching volume 2ece6108-dd74-4d84-9023-68ce2cb74e31 to /dev/vdb
Aug 16 12:41:01 user nova-compute[73520]: DEBUG os_brick.utils [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ece190-5dae-421e-add5-8ac92e6b40f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd4d865-c139-4664-9236-b558021018c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[96658ac7-06da-418a-802e-ac29e8ded29c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bc3a61-f11a-47de-b8db-1427bd860409]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:41:01 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8501bab-d649-4baa-a0e8-99e860ed999f]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG os_brick.utils [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updating existing volume attachment record: f704c7fd-e86f-48b5-a3fe-672e6c432e8d {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:41:01 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:41:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:03 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updating instance_info_cache with network_info: [{"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:41:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-26b0286b-9021-4859-88ac-760e7249a3d2" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:41:03 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:41:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FLKdeHPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:41:12 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:41:12 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:41:12 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba0b39a-8953-4c46-8f28-503baeb4482f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:41:12 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6effd185-fb26-42fb-9e36-99d860ed1e2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31] added
Aug 16 12:41:12 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e3bf22-1def-4923-9556-bdeacdc114b7]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fd5d4b-0ac2-4431-9ba8-8cdbc222f8c1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FLKdeHPM {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FLKdeHPM" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12edb58-d2e5-49f8-a1bf-3e062798813c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FLKdeHPM'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6eb683-7a3e-4169-8384-ce3fb5856f84]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dd68d9-6ca9-4863-8c41-a76f9ef7f14e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:41:12 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:41:12 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:41:12 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 12:41:12 user nova-compute[73520]: 
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffead543-e409-434f-93af-4fd30c1da542]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31, portal: 172.16.0.220,3260]
Aug 16 12:41:12 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31, portal: 172.16.0.220,3260] successful.
Aug 16 12:41:12 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc56c58-50ea-4d7d-8199-c230f5791a74]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[908f4fed-3721-4559-96e0-45b6df35a920]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 (non-flash)
Aug 16 12:41:12 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 (non-flash)
Aug 16 12:41:12 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f21bcb-183a-4b27-9431-90ced2c66cbd]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FLKdeHPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:41:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:41:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:41:13 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23362643430373963', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:41:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362643430373963', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:41:13 user nova-compute[73520]: DEBUG nova.objects.instance [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'flavor' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:41:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:41:13 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:41:13 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:41:13 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:41:13 user nova-compute[73520]:   <serial>2ece6108-dd74-4d84-9023-68ce2cb74e31</serial>
Aug 16 12:41:13 user nova-compute[73520]: </disk>
Aug 16 12:41:13 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:41:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:41:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:41:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No VIF found with MAC fa:16:3e:43:87:09, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:41:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-3908ca1e-d99d-42b4-86f5-2964c91cbe74 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.863s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:41:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:41:16 user nova-compute[73520]: INFO nova.compute.manager [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Detaching volume 2ece6108-dd74-4d84-9023-68ce2cb74e31
Aug 16 12:41:16 user nova-compute[73520]: INFO nova.virt.block_device [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Attempting to driver detach volume 2ece6108-dd74-4d84-9023-68ce2cb74e31 from mountpoint /dev/vdb
Aug 16 12:41:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Attempting to detach device vdb from instance d034d519-491c-4963-95b1-48eaf2d81653 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:41:16 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:41:16 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:41:16 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:41:16 user nova-compute[73520]:   <serial>2ece6108-dd74-4d84-9023-68ce2cb74e31</serial>
Aug 16 12:41:16 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:41:16 user nova-compute[73520]: </disk>
Aug 16 12:41:16 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:41:16 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Successfully detached device vdb from instance d034d519-491c-4963-95b1-48eaf2d81653 from the persistent domain config.
Aug 16 12:41:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d034d519-491c-4963-95b1-48eaf2d81653 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:41:16 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:41:16 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:41:16 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:41:16 user nova-compute[73520]:   <serial>2ece6108-dd74-4d84-9023-68ce2cb74e31</serial>
Aug 16 12:41:16 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:41:16 user nova-compute[73520]: </disk>
Aug 16 12:41:16 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692189676.5738063, d034d519-491c-4963-95b1-48eaf2d81653 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:41:16 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Successfully detached device vdb from instance d034d519-491c-4963-95b1-48eaf2d81653 from the live domain config.
Aug 16 12:41:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FLKdeHPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:41:16 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaff531-dfaf-4706-9839-78df60d1c1c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6845e15f-d805-49a2-a5fa-fa1f3175d6e1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 (non-flash)
Aug 16 12:41:16 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 (non-flash)
Aug 16 12:41:16 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c120af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[15da32a6-8cb9-44a6-bba5-4591b13d30b6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b00805-0cb6-43d2-8f3c-6a4d0a4ac41f]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4beb274-f326-45f6-8ce1-497c509f90a6]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4965a6f9-d9fd-46f2-99b4-22086b5b4f96]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7bd075-5dbc-491f-bd11-4e7cbee1cf33]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0414bb78-c7b2-458a-b283-8a2e399a16aa]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31, portal: 172.16.0.220,3260]
Aug 16 12:41:16 user nova-compute[73520]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31, portal: 172.16.0.220,3260] successful.
Aug 16 12:41:16 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ece6108-dd74-4d84-9023-68ce2cb74e31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[82084a62-b420-4b4c-961a-f316f1b55c75]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] <== disconnect_volume: return (284ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:41:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:41:17 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'flavor' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:41:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b81584f6-4d00-40e5-96a1-8fb7b6e06910 tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.730s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:41:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:22 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:41:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:41:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:41:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:41:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:41:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:41:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:41:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:41:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:41:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:47 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:41:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:41:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:41:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:41:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:41:50 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:41:51 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:41:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:41:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:41:57 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:41:59 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:42:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:00 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:42:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:01 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:42:01 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:42:01 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8519MB free_disk=25.322303771972656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:42:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:01 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 26b0286b-9021-4859-88ac-760e7249a3d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:42:01 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d034d519-491c-4963-95b1-48eaf2d81653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:42:01 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:42:01 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:42:01 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:42:01 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:42:01 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:42:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:42:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:42:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:42:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:42:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:03 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:42:03 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:42:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:42:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:42:03 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:42:04 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updating instance_info_cache with network_info: [{"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:42:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:42:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:42:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'flavor' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:11 user nova-compute[73520]: INFO nova.compute.manager [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Attaching volume bbdc23fe-1414-4398-9b27-a1738177574d to /dev/vdb
Aug 16 12:42:11 user nova-compute[73520]: DEBUG os_brick.utils [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0e3984-0cc0-4fca-a265-926636175795]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af52aa6-5e5a-4aa6-89e8-0938bb406a3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a732dad-4784-46eb-80c5-82f78e9d1521]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[51429c93-0c3b-4e1f-8a07-7fa049b7007c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:42:11 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:42:11 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9e66e0-be3f-4560-bb49-afffb89030af]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG os_brick.utils [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:42:11 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updating existing volume attachment record: d132ed31-8545-42b7-aeb2-4bb90cd9249e {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:42:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:42:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:42:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:42:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:42:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:42:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Acquiring lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:12 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:42:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:13 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:42:13 user nova-compute[73520]: INFO nova.compute.claims [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Claim successful on node user
Aug 16 12:42:13 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:42:13 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:42:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:42:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:42:13 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:42:13 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:42:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:42:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:42:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:42:13 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Creating image(s)
Aug 16 12:42:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Acquiring lock "/opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "/opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "/opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.236s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.230s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk 1073741824" returned: 0 in 0.070s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.199s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Cannot resize image /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lazy-loading 'migration_context' on Instance uuid 60f4612b-c0f5-499b-ac43-b644e7ee5cdd {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG nova.policy [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f0c2a474bde4ea69504beacffa8c532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbb89fe54af4b05b1d1a0c8de3d3129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Ensure instance console log exists: /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:16 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Successfully created port: 8b3afb06-3457-47a1-ae05-b32343f794a8 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:42:17 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Successfully updated port: 8b3afb06-3457-47a1-ae05-b32343f794a8 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Acquiring lock "refresh_cache-60f4612b-c0f5-499b-ac43-b644e7ee5cdd" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Acquired lock "refresh_cache-60f4612b-c0f5-499b-ac43-b644e7ee5cdd" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-cd57a75e-cbb0-407e-9ce7-ee1e35fb5556 req-ccfdf3ac-209b-438d-abad-1346b209745a service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Received event network-changed-8b3afb06-3457-47a1-ae05-b32343f794a8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.compute.manager [req-cd57a75e-cbb0-407e-9ce7-ee1e35fb5556 req-ccfdf3ac-209b-438d-abad-1346b209745a service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Refreshing instance network info cache due to event network-changed-8b3afb06-3457-47a1-ae05-b32343f794a8. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cd57a75e-cbb0-407e-9ce7-ee1e35fb5556 req-ccfdf3ac-209b-438d-abad-1346b209745a service nova] Acquiring lock "refresh_cache-60f4612b-c0f5-499b-ac43-b644e7ee5cdd" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.network.neutron [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Updating instance_info_cache with network_info: [{"id": "8b3afb06-3457-47a1-ae05-b32343f794a8", "address": "fa:16:3e:70:07:c8", "network": {"id": "8b1b66b1-8966-424e-8ed8-6592a4467faf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c36b9057d00349558c96f16d77c55ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3afb06-34", "ovs_interfaceid": "8b3afb06-3457-47a1-ae05-b32343f794a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Releasing lock "refresh_cache-60f4612b-c0f5-499b-ac43-b644e7ee5cdd" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Instance network_info: |[{"id": "8b3afb06-3457-47a1-ae05-b32343f794a8", "address": "fa:16:3e:70:07:c8", "network": {"id": "8b1b66b1-8966-424e-8ed8-6592a4467faf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c36b9057d00349558c96f16d77c55ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3afb06-34", "ovs_interfaceid": "8b3afb06-3457-47a1-ae05-b32343f794a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cd57a75e-cbb0-407e-9ce7-ee1e35fb5556 req-ccfdf3ac-209b-438d-abad-1346b209745a service nova] Acquired lock "refresh_cache-60f4612b-c0f5-499b-ac43-b644e7ee5cdd" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.network.neutron [req-cd57a75e-cbb0-407e-9ce7-ee1e35fb5556 req-ccfdf3ac-209b-438d-abad-1346b209745a service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Refreshing network info cache for port 8b3afb06-3457-47a1-ae05-b32343f794a8 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Start _get_guest_xml network_info=[{"id": "8b3afb06-3457-47a1-ae05-b32343f794a8", "address": "fa:16:3e:70:07:c8", "network": {"id": "8b1b66b1-8966-424e-8ed8-6592a4467faf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c36b9057d00349558c96f16d77c55ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3afb06-34", "ovs_interfaceid": "8b3afb06-3457-47a1-ae05-b32343f794a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:42:18 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:42:18 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:42:18 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-287860474',display_name='tempest-VolumesNegativeTest-instance-287860474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-287860474',id=47,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbbb89fe54af4b05b1d1a0c8de3d3129',ramdisk_id='',reservation_id='r-yk53v8wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1554593110',owner_user_name='tempest-VolumesNegativeTest-1554593110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:42:14Z,user_data=None,user_id='6f0c2a474bde4ea69504beacffa8c532',uuid=60f4612b-c0f5-499b-ac43-b644e7ee5cdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b3afb06-3457-47a1-ae05-b32343f794a8", "address": "fa:16:3e:70:07:c8", "network": {"id": "8b1b66b1-8966-424e-8ed8-6592a4467faf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c36b9057d00349558c96f16d77c55ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3afb06-34", "ovs_interfaceid": "8b3afb06-3457-47a1-ae05-b32343f794a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Converting VIF {"id": "8b3afb06-3457-47a1-ae05-b32343f794a8", "address": "fa:16:3e:70:07:c8", "network": {"id": "8b1b66b1-8966-424e-8ed8-6592a4467faf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c36b9057d00349558c96f16d77c55ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3afb06-34", "ovs_interfaceid": "8b3afb06-3457-47a1-ae05-b32343f794a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:07:c8,bridge_name='br-int',has_traffic_filtering=True,id=8b3afb06-3457-47a1-ae05-b32343f794a8,network=Network(8b1b66b1-8966-424e-8ed8-6592a4467faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3afb06-34') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lazy-loading 'pci_devices' on Instance uuid 60f4612b-c0f5-499b-ac43-b644e7ee5cdd {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:42:19 user nova-compute[73520]:   <uuid>60f4612b-c0f5-499b-ac43-b644e7ee5cdd</uuid>
Aug 16 12:42:19 user nova-compute[73520]:   <name>instance-0000002f</name>
Aug 16 12:42:19 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:42:19 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:42:19 user nova-compute[73520]:   <metadata>
Aug 16 12:42:19 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:42:19 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:42:19 user nova-compute[73520]:       <nova:name>tempest-VolumesNegativeTest-instance-287860474</nova:name>
Aug 16 12:42:19 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:42:18</nova:creationTime>
Aug 16 12:42:19 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:42:19 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:42:19 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:42:19 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:42:19 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:42:19 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:42:19 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:42:19 user nova-compute[73520]:       <nova:owner>
Aug 16 12:42:19 user nova-compute[73520]:         <nova:user uuid="6f0c2a474bde4ea69504beacffa8c532">tempest-VolumesNegativeTest-1554593110-project-member</nova:user>
Aug 16 12:42:19 user nova-compute[73520]:         <nova:project uuid="cbbb89fe54af4b05b1d1a0c8de3d3129">tempest-VolumesNegativeTest-1554593110</nova:project>
Aug 16 12:42:19 user nova-compute[73520]:       </nova:owner>
Aug 16 12:42:19 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:42:19 user nova-compute[73520]:       <nova:ports>
Aug 16 12:42:19 user nova-compute[73520]:         <nova:port uuid="8b3afb06-3457-47a1-ae05-b32343f794a8">
Aug 16 12:42:19 user nova-compute[73520]:           <nova:ip type="fixed" address="192.168.233.141" ipVersion="4"/>
Aug 16 12:42:19 user nova-compute[73520]:         </nova:port>
Aug 16 12:42:19 user nova-compute[73520]:       </nova:ports>
Aug 16 12:42:19 user nova-compute[73520]:     </nova:instance>
Aug 16 12:42:19 user nova-compute[73520]:   </metadata>
Aug 16 12:42:19 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:42:19 user nova-compute[73520]:     <system>
Aug 16 12:42:19 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:42:19 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:42:19 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:42:19 user nova-compute[73520]:       <entry name="serial">60f4612b-c0f5-499b-ac43-b644e7ee5cdd</entry>
Aug 16 12:42:19 user nova-compute[73520]:       <entry name="uuid">60f4612b-c0f5-499b-ac43-b644e7ee5cdd</entry>
Aug 16 12:42:19 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:42:19 user nova-compute[73520]:     </system>
Aug 16 12:42:19 user nova-compute[73520]:   </sysinfo>
Aug 16 12:42:19 user nova-compute[73520]:   <os>
Aug 16 12:42:19 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:42:19 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:42:19 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:42:19 user nova-compute[73520]:   </os>
Aug 16 12:42:19 user nova-compute[73520]:   <features>
Aug 16 12:42:19 user nova-compute[73520]:     <acpi/>
Aug 16 12:42:19 user nova-compute[73520]:     <apic/>
Aug 16 12:42:19 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:42:19 user nova-compute[73520]:   </features>
Aug 16 12:42:19 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:42:19 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:42:19 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:42:19 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:42:19 user nova-compute[73520]:   </clock>
Aug 16 12:42:19 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:42:19 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:42:19 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:42:19 user nova-compute[73520]:   </cpu>
Aug 16 12:42:19 user nova-compute[73520]:   <devices>
Aug 16 12:42:19 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:42:19 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:42:19 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk"/>
Aug 16 12:42:19 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:42:19 user nova-compute[73520]:     </disk>
Aug 16 12:42:19 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:42:19 user nova-compute[73520]:       <mac address="fa:16:3e:70:07:c8"/>
Aug 16 12:42:19 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:42:19 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:42:19 user nova-compute[73520]:       <target dev="tap8b3afb06-34"/>
Aug 16 12:42:19 user nova-compute[73520]:     </interface>
Aug 16 12:42:19 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:42:19 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/console.log" append="off"/>
Aug 16 12:42:19 user nova-compute[73520]:     </serial>
Aug 16 12:42:19 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:42:19 user nova-compute[73520]:     <video>
Aug 16 12:42:19 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:42:19 user nova-compute[73520]:     </video>
Aug 16 12:42:19 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:42:19 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:42:19 user nova-compute[73520]:     </rng>
Aug 16 12:42:19 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:42:19 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:42:19 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:42:19 user nova-compute[73520]:     </memballoon>
Aug 16 12:42:19 user nova-compute[73520]:   </devices>
Aug 16 12:42:19 user nova-compute[73520]: </domain>
Aug 16 12:42:19 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-287860474',display_name='tempest-VolumesNegativeTest-instance-287860474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-287860474',id=47,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbbb89fe54af4b05b1d1a0c8de3d3129',ramdisk_id='',reservation_id='r-yk53v8wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1554593110',owner_user_name='tempest-VolumesNegativeTest-1554593110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:42:14Z,user_data=None,user_id='6f0c2a474bde4ea69504beacffa8c532',uuid=60f4612b-c0f5-499b-ac43-b644e7ee5cdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b3afb06-3457-47a1-ae05-b32343f794a8", "address": "fa:16:3e:70:07:c8", "network": {"id": "8b1b66b1-8966-424e-8ed8-6592a4467faf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c36b9057d00349558c96f16d77c55ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3afb06-34", "ovs_interfaceid": "8b3afb06-3457-47a1-ae05-b32343f794a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Converting VIF {"id": "8b3afb06-3457-47a1-ae05-b32343f794a8", "address": "fa:16:3e:70:07:c8", "network": {"id": "8b1b66b1-8966-424e-8ed8-6592a4467faf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c36b9057d00349558c96f16d77c55ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3afb06-34", "ovs_interfaceid": "8b3afb06-3457-47a1-ae05-b32343f794a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:07:c8,bridge_name='br-int',has_traffic_filtering=True,id=8b3afb06-3457-47a1-ae05-b32343f794a8,network=Network(8b1b66b1-8966-424e-8ed8-6592a4467faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3afb06-34') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG os_vif [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:07:c8,bridge_name='br-int',has_traffic_filtering=True,id=8b3afb06-3457-47a1-ae05-b32343f794a8,network=Network(8b1b66b1-8966-424e-8ed8-6592a4467faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3afb06-34') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b3afb06-34, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b3afb06-34, col_values=(('external_ids', {'iface-id': '8b3afb06-3457-47a1-ae05-b32343f794a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:07:c8', 'vm-uuid': '60f4612b-c0f5-499b-ac43-b644e7ee5cdd'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:19 user nova-compute[73520]: INFO os_vif [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:07:c8,bridge_name='br-int',has_traffic_filtering=True,id=8b3afb06-3457-47a1-ae05-b32343f794a8,network=Network(8b1b66b1-8966-424e-8ed8-6592a4467faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3afb06-34')
Aug 16 12:42:19 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] No VIF found with MAC fa:16:3e:70:07:c8, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG nova.network.neutron [req-cd57a75e-cbb0-407e-9ce7-ee1e35fb5556 req-ccfdf3ac-209b-438d-abad-1346b209745a service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Updated VIF entry in instance network info cache for port 8b3afb06-3457-47a1-ae05-b32343f794a8. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG nova.network.neutron [req-cd57a75e-cbb0-407e-9ce7-ee1e35fb5556 req-ccfdf3ac-209b-438d-abad-1346b209745a service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Updating instance_info_cache with network_info: [{"id": "8b3afb06-3457-47a1-ae05-b32343f794a8", "address": "fa:16:3e:70:07:c8", "network": {"id": "8b1b66b1-8966-424e-8ed8-6592a4467faf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c36b9057d00349558c96f16d77c55ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3afb06-34", "ovs_interfaceid": "8b3afb06-3457-47a1-ae05-b32343f794a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-cd57a75e-cbb0-407e-9ce7-ee1e35fb5556 req-ccfdf3ac-209b-438d-abad-1346b209745a service nova] Releasing lock "refresh_cache-60f4612b-c0f5-499b-ac43-b644e7ee5cdd" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:42:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-c9ca5764-a146-468b-b231-89399ed363f1 req-756210e5-ad5c-4185-950d-fe37e63bba22 service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Received event network-vif-plugged-8b3afb06-3457-47a1-ae05-b32343f794a8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:42:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c9ca5764-a146-468b-b231-89399ed363f1 req-756210e5-ad5c-4185-950d-fe37e63bba22 service nova] Acquiring lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c9ca5764-a146-468b-b231-89399ed363f1 req-756210e5-ad5c-4185-950d-fe37e63bba22 service nova] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c9ca5764-a146-468b-b231-89399ed363f1 req-756210e5-ad5c-4185-950d-fe37e63bba22 service nova] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-c9ca5764-a146-468b-b231-89399ed363f1 req-756210e5-ad5c-4185-950d-fe37e63bba22 service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] No waiting events found dispatching network-vif-plugged-8b3afb06-3457-47a1-ae05-b32343f794a8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:42:20 user nova-compute[73520]: WARNING nova.compute.manager [req-c9ca5764-a146-468b-b231-89399ed363f1 req-756210e5-ad5c-4185-950d-fe37e63bba22 service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Received unexpected event network-vif-plugged-8b3afb06-3457-47a1-ae05-b32343f794a8 for instance with vm_state building and task_state spawning.
Aug 16 12:42:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGplJXqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:42:22 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:42:22 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:42:22 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b31892e-78f7-4ef4-aaae-f9f7148ce140]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:42:22 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e649632-6c91-41d7-a853-92d31eebbb1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d] added
Aug 16 12:42:22 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6d682c-e531-43e1-b204-03f03b501cf5]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[160f8b80-ad58-44f0-abb8-1978c63c7559]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGplJXqH {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGplJXqH" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6222c9e1-0224-4613-9066-787ec8f238a6]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EGplJXqH'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fc96db-42d8-445f-a92f-e9a82e951c61]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c6ddb1-9821-453a-b40e-d82080fd1042]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:42:22 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:42:22 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:42:22 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 12:42:22 user nova-compute[73520]: 
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecebbf3-209b-47cf-88e2-a01607e752a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d, portal: 172.16.0.220,3260]
Aug 16 12:42:22 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d, portal: 172.16.0.220,3260] successful.
Aug 16 12:42:22 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d129dc-b680-47a6-bd3a-0e00d3d1396d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f65434-9429-43e4-bc66-5471eeadae13]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d (non-flash)
Aug 16 12:42:22 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d (non-flash)
Aug 16 12:42:22 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f558d9-ee16-452e-a6c1-c702d4301d62]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-8009ed78-11b6-430e-97a6-62dcfe7a5a25 req-4ef7bdb9-2e60-4b88-81ee-046b2880132d service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Received event network-vif-plugged-8b3afb06-3457-47a1-ae05-b32343f794a8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8009ed78-11b6-430e-97a6-62dcfe7a5a25 req-4ef7bdb9-2e60-4b88-81ee-046b2880132d service nova] Acquiring lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8009ed78-11b6-430e-97a6-62dcfe7a5a25 req-4ef7bdb9-2e60-4b88-81ee-046b2880132d service nova] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8009ed78-11b6-430e-97a6-62dcfe7a5a25 req-4ef7bdb9-2e60-4b88-81ee-046b2880132d service nova] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-8009ed78-11b6-430e-97a6-62dcfe7a5a25 req-4ef7bdb9-2e60-4b88-81ee-046b2880132d service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] No waiting events found dispatching network-vif-plugged-8b3afb06-3457-47a1-ae05-b32343f794a8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:42:22 user nova-compute[73520]: WARNING nova.compute.manager [req-8009ed78-11b6-430e-97a6-62dcfe7a5a25 req-4ef7bdb9-2e60-4b88-81ee-046b2880132d service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Received unexpected event network-vif-plugged-8b3afb06-3457-47a1-ae05-b32343f794a8 for instance with vm_state building and task_state spawning.
Aug 16 12:42:22 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189742.9669378, 60f4612b-c0f5-499b-ac43-b644e7ee5cdd => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:42:22 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] VM Resumed (Lifecycle Event)
Aug 16 12:42:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:42:22 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Instance spawned successfully.
Aug 16 12:42:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:42:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:42:23 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189742.9713657, 60f4612b-c0f5-499b-ac43-b644e7ee5cdd => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:42:23 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] VM Started (Lifecycle Event)
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:42:23 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:42:23 user nova-compute[73520]: INFO nova.compute.manager [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Took 9.31 seconds to spawn the instance on the hypervisor.
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:42:23 user nova-compute[73520]: INFO nova.compute.manager [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Took 10.18 seconds to build instance.
Aug 16 12:42:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b4fdc1f6-a2b6-4c06-8231-87be68a448f4 tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.314s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGplJXqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23130316431326537', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130316431326537', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.objects.instance [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'flavor' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:42:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:42:23 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:42:23 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:42:23 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:42:23 user nova-compute[73520]:   <serial>bbdc23fe-1414-4398-9b27-a1738177574d</serial>
Aug 16 12:42:23 user nova-compute[73520]: </disk>
Aug 16 12:42:23 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:42:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:24 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:42:24 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:42:24 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No VIF found with MAC fa:16:3e:43:87:09, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:42:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-b015d2fa-c07e-4a88-af52-10623b90cd5a tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.203s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:26 user nova-compute[73520]: INFO nova.compute.manager [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Detaching volume bbdc23fe-1414-4398-9b27-a1738177574d
Aug 16 12:42:26 user nova-compute[73520]: INFO nova.virt.block_device [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Attempting to driver detach volume bbdc23fe-1414-4398-9b27-a1738177574d from mountpoint /dev/vdb
Aug 16 12:42:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Attempting to detach device vdb from instance d034d519-491c-4963-95b1-48eaf2d81653 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:42:26 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:42:26 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:42:26 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:42:26 user nova-compute[73520]:   <serial>bbdc23fe-1414-4398-9b27-a1738177574d</serial>
Aug 16 12:42:26 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:42:26 user nova-compute[73520]: </disk>
Aug 16 12:42:26 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:42:26 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Successfully detached device vdb from instance d034d519-491c-4963-95b1-48eaf2d81653 from the persistent domain config.
Aug 16 12:42:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d034d519-491c-4963-95b1-48eaf2d81653 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:42:26 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:42:26 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:42:26 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:42:26 user nova-compute[73520]:   <serial>bbdc23fe-1414-4398-9b27-a1738177574d</serial>
Aug 16 12:42:26 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:42:26 user nova-compute[73520]: </disk>
Aug 16 12:42:26 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692189746.8973486, d034d519-491c-4963-95b1-48eaf2d81653 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:42:26 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Successfully detached device vdb from instance d034d519-491c-4963-95b1-48eaf2d81653 from the live domain config.
Aug 16 12:42:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGplJXqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:42:26 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:42:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec392fa-558f-47ea-9db8-7d31f46ad431]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76fa7df-596a-45a6-85a6-e81aaf099eca]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d (non-flash)
Aug 16 12:42:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d (non-flash)
Aug 16 12:42:26 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa76c0f28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afa4da0-8fe1-4a32-9fe9-44badfae0608]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:26 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[617ca944-e507-4f19-8ea2-2b30fe94fd0e]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08c7c3a-4e87-4e2e-aac2-4e9c70c4af1d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.094s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[985dd322-27a9-4b43-a60e-99e69e860e63]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[718ed6b1-e5ed-4da5-8ee1-e5c4a748e046]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --logout" returned: 0 in 0.111s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a06f854-a3bc-4da1-8af0-87fbb9552213]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d, portal: 172.16.0.220,3260]
Aug 16 12:42:27 user nova-compute[73520]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d, portal: 172.16.0.220,3260] successful.
Aug 16 12:42:27 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbdc23fe-1414-4398-9b27-a1738177574d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[583c140b-c12c-4ede-b962-070f0e3ba41c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] <== disconnect_volume: return (398ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:42:27 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:42:28 user nova-compute[73520]: DEBUG nova.objects.instance [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'flavor' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:42:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-34495748-f649-49e5-a215-0d1774af2f2d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.980s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:42:29 user nova-compute[73520]: INFO nova.compute.claims [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Claim successful on node user
Aug 16 12:42:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:42:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:42:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG nova.policy [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72663ad9bd9945b098337e0ebe4bef19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1282c7409c44eae81facffc98d5edc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:42:29 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Creating image(s)
Aug 16 12:42:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "/opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "/opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "/opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.198s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk 1073741824" returned: 0 in 0.056s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.172s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Successfully created port: 452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Cannot resize image /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lazy-loading 'migration_context' on Instance uuid 38a325f8-e3cc-4033-92dd-dd47b6b4190c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Ensure instance console log exists: /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:31 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Successfully updated port: 452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:42:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:42:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquired lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:42:31 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:42:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-26c22d11-f841-4bcb-aa39-60dbf621400b req-9f313078-947a-456c-885d-4eacfd8c9984 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Received event network-changed-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:42:31 user nova-compute[73520]: DEBUG nova.compute.manager [req-26c22d11-f841-4bcb-aa39-60dbf621400b req-9f313078-947a-456c-885d-4eacfd8c9984 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Refreshing instance network info cache due to event network-changed-452f5c2d-20dc-4ac6-b875-a200d55f0cc0. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:42:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-26c22d11-f841-4bcb-aa39-60dbf621400b req-9f313078-947a-456c-885d-4eacfd8c9984 service nova] Acquiring lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:42:31 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.network.neutron [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updating instance_info_cache with network_info: [{"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Releasing lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Instance network_info: |[{"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-26c22d11-f841-4bcb-aa39-60dbf621400b req-9f313078-947a-456c-885d-4eacfd8c9984 service nova] Acquired lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.network.neutron [req-26c22d11-f841-4bcb-aa39-60dbf621400b req-9f313078-947a-456c-885d-4eacfd8c9984 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Refreshing network info cache for port 452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Start _get_guest_xml network_info=[{"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:42:32 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:42:32 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1421016579',display_name='tempest-TestStampPattern-server-1421016579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1421016579',id=48,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwRMExwQxQHRu0VQoTRBe9PUDpaEXm/5+Y0L1d60IAAQB1PQGosro0QC3rWNctmtdmkB0qFbKn1mN5TkKQK3A37SWFY5Z4Uqe3buZVFP2WzkA3jc3jRmdmYRx8pXMqNWw==',key_name='tempest-TestStampPattern-1822850313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1282c7409c44eae81facffc98d5edc7',ramdisk_id='',reservation_id='r-1qviih9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-160903608',owner_user_name='tempest-TestStampPattern-160903608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:42:30Z,user_data=None,user_id='72663ad9bd9945b098337e0ebe4bef19',uuid=38a325f8-e3cc-4033-92dd-dd47b6b4190c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Converting VIF {"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:75:76,bridge_name='br-int',has_traffic_filtering=True,id=452f5c2d-20dc-4ac6-b875-a200d55f0cc0,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452f5c2d-20') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lazy-loading 'pci_devices' on Instance uuid 38a325f8-e3cc-4033-92dd-dd47b6b4190c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:42:32 user nova-compute[73520]:   <uuid>38a325f8-e3cc-4033-92dd-dd47b6b4190c</uuid>
Aug 16 12:42:32 user nova-compute[73520]:   <name>instance-00000030</name>
Aug 16 12:42:32 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:42:32 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:42:32 user nova-compute[73520]:   <metadata>
Aug 16 12:42:32 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:42:32 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:42:32 user nova-compute[73520]:       <nova:name>tempest-TestStampPattern-server-1421016579</nova:name>
Aug 16 12:42:32 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:42:32</nova:creationTime>
Aug 16 12:42:32 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:42:32 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:42:32 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:42:32 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:42:32 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:42:32 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:42:32 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:42:32 user nova-compute[73520]:       <nova:owner>
Aug 16 12:42:32 user nova-compute[73520]:         <nova:user uuid="72663ad9bd9945b098337e0ebe4bef19">tempest-TestStampPattern-160903608-project-member</nova:user>
Aug 16 12:42:32 user nova-compute[73520]:         <nova:project uuid="c1282c7409c44eae81facffc98d5edc7">tempest-TestStampPattern-160903608</nova:project>
Aug 16 12:42:32 user nova-compute[73520]:       </nova:owner>
Aug 16 12:42:32 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:42:32 user nova-compute[73520]:       <nova:ports>
Aug 16 12:42:32 user nova-compute[73520]:         <nova:port uuid="452f5c2d-20dc-4ac6-b875-a200d55f0cc0">
Aug 16 12:42:32 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 12:42:32 user nova-compute[73520]:         </nova:port>
Aug 16 12:42:32 user nova-compute[73520]:       </nova:ports>
Aug 16 12:42:32 user nova-compute[73520]:     </nova:instance>
Aug 16 12:42:32 user nova-compute[73520]:   </metadata>
Aug 16 12:42:32 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:42:32 user nova-compute[73520]:     <system>
Aug 16 12:42:32 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:42:32 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:42:32 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:42:32 user nova-compute[73520]:       <entry name="serial">38a325f8-e3cc-4033-92dd-dd47b6b4190c</entry>
Aug 16 12:42:32 user nova-compute[73520]:       <entry name="uuid">38a325f8-e3cc-4033-92dd-dd47b6b4190c</entry>
Aug 16 12:42:32 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:42:32 user nova-compute[73520]:     </system>
Aug 16 12:42:32 user nova-compute[73520]:   </sysinfo>
Aug 16 12:42:32 user nova-compute[73520]:   <os>
Aug 16 12:42:32 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:42:32 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:42:32 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:42:32 user nova-compute[73520]:   </os>
Aug 16 12:42:32 user nova-compute[73520]:   <features>
Aug 16 12:42:32 user nova-compute[73520]:     <acpi/>
Aug 16 12:42:32 user nova-compute[73520]:     <apic/>
Aug 16 12:42:32 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:42:32 user nova-compute[73520]:   </features>
Aug 16 12:42:32 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:42:32 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:42:32 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:42:32 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:42:32 user nova-compute[73520]:   </clock>
Aug 16 12:42:32 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:42:32 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:42:32 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:42:32 user nova-compute[73520]:   </cpu>
Aug 16 12:42:32 user nova-compute[73520]:   <devices>
Aug 16 12:42:32 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:42:32 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:42:32 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk"/>
Aug 16 12:42:32 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:42:32 user nova-compute[73520]:     </disk>
Aug 16 12:42:32 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:42:32 user nova-compute[73520]:       <mac address="fa:16:3e:51:75:76"/>
Aug 16 12:42:32 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:42:32 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:42:32 user nova-compute[73520]:       <target dev="tap452f5c2d-20"/>
Aug 16 12:42:32 user nova-compute[73520]:     </interface>
Aug 16 12:42:32 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:42:32 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/console.log" append="off"/>
Aug 16 12:42:32 user nova-compute[73520]:     </serial>
Aug 16 12:42:32 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:42:32 user nova-compute[73520]:     <video>
Aug 16 12:42:32 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:42:32 user nova-compute[73520]:     </video>
Aug 16 12:42:32 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:42:32 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:42:32 user nova-compute[73520]:     </rng>
Aug 16 12:42:32 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:42:32 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:42:32 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:42:32 user nova-compute[73520]:     </memballoon>
Aug 16 12:42:32 user nova-compute[73520]:   </devices>
Aug 16 12:42:32 user nova-compute[73520]: </domain>
Aug 16 12:42:32 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1421016579',display_name='tempest-TestStampPattern-server-1421016579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1421016579',id=48,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwRMExwQxQHRu0VQoTRBe9PUDpaEXm/5+Y0L1d60IAAQB1PQGosro0QC3rWNctmtdmkB0qFbKn1mN5TkKQK3A37SWFY5Z4Uqe3buZVFP2WzkA3jc3jRmdmYRx8pXMqNWw==',key_name='tempest-TestStampPattern-1822850313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1282c7409c44eae81facffc98d5edc7',ramdisk_id='',reservation_id='r-1qviih9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-160903608',owner_user_name='tempest-TestStampPattern-160903608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:42:30Z,user_data=None,user_id='72663ad9bd9945b098337e0ebe4bef19',uuid=38a325f8-e3cc-4033-92dd-dd47b6b4190c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Converting VIF {"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:75:76,bridge_name='br-int',has_traffic_filtering=True,id=452f5c2d-20dc-4ac6-b875-a200d55f0cc0,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452f5c2d-20') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG os_vif [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:75:76,bridge_name='br-int',has_traffic_filtering=True,id=452f5c2d-20dc-4ac6-b875-a200d55f0cc0,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452f5c2d-20') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap452f5c2d-20, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap452f5c2d-20, col_values=(('external_ids', {'iface-id': '452f5c2d-20dc-4ac6-b875-a200d55f0cc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:75:76', 'vm-uuid': '38a325f8-e3cc-4033-92dd-dd47b6b4190c'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:32 user nova-compute[73520]: INFO os_vif [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:75:76,bridge_name='br-int',has_traffic_filtering=True,id=452f5c2d-20dc-4ac6-b875-a200d55f0cc0,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452f5c2d-20')
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] No VIF found with MAC fa:16:3e:51:75:76, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.network.neutron [req-26c22d11-f841-4bcb-aa39-60dbf621400b req-9f313078-947a-456c-885d-4eacfd8c9984 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updated VIF entry in instance network info cache for port 452f5c2d-20dc-4ac6-b875-a200d55f0cc0. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG nova.network.neutron [req-26c22d11-f841-4bcb-aa39-60dbf621400b req-9f313078-947a-456c-885d-4eacfd8c9984 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updating instance_info_cache with network_info: [{"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:42:32 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-26c22d11-f841-4bcb-aa39-60dbf621400b req-9f313078-947a-456c-885d-4eacfd8c9984 service nova] Releasing lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:42:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-57e339d9-1367-4470-997e-18e4d175e7a4 req-edb3b934-b1c2-40aa-88f4-c9268e87d04b service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Received event network-vif-plugged-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:42:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-57e339d9-1367-4470-997e-18e4d175e7a4 req-edb3b934-b1c2-40aa-88f4-c9268e87d04b service nova] Acquiring lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-57e339d9-1367-4470-997e-18e4d175e7a4 req-edb3b934-b1c2-40aa-88f4-c9268e87d04b service nova] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-57e339d9-1367-4470-997e-18e4d175e7a4 req-edb3b934-b1c2-40aa-88f4-c9268e87d04b service nova] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:33 user nova-compute[73520]: DEBUG nova.compute.manager [req-57e339d9-1367-4470-997e-18e4d175e7a4 req-edb3b934-b1c2-40aa-88f4-c9268e87d04b service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] No waiting events found dispatching network-vif-plugged-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:42:33 user nova-compute[73520]: WARNING nova.compute.manager [req-57e339d9-1367-4470-997e-18e4d175e7a4 req-edb3b934-b1c2-40aa-88f4-c9268e87d04b service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Received unexpected event network-vif-plugged-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 for instance with vm_state building and task_state spawning.
Aug 16 12:42:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189755.6682773, 38a325f8-e3cc-4033-92dd-dd47b6b4190c => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:42:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] VM Resumed (Lifecycle Event)
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:42:35 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Instance spawned successfully.
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:42:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189755.669538, 38a325f8-e3cc-4033-92dd-dd47b6b4190c => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:42:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] VM Started (Lifecycle Event)
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:42:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:42:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:42:35 user nova-compute[73520]: INFO nova.compute.manager [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Took 6.37 seconds to build instance.
Aug 16 12:42:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c44b0602-b248-4ab9-98eb-853fa19aeed3 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.471s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-6252a92c-8b19-47ea-804b-486d4e99aa62 req-b996ba8d-9428-4923-9822-1c565a63b861 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Received event network-vif-plugged-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6252a92c-8b19-47ea-804b-486d4e99aa62 req-b996ba8d-9428-4923-9822-1c565a63b861 service nova] Acquiring lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6252a92c-8b19-47ea-804b-486d4e99aa62 req-b996ba8d-9428-4923-9822-1c565a63b861 service nova] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6252a92c-8b19-47ea-804b-486d4e99aa62 req-b996ba8d-9428-4923-9822-1c565a63b861 service nova] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-6252a92c-8b19-47ea-804b-486d4e99aa62 req-b996ba8d-9428-4923-9822-1c565a63b861 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] No waiting events found dispatching network-vif-plugged-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:42:35 user nova-compute[73520]: WARNING nova.compute.manager [req-6252a92c-8b19-47ea-804b-486d4e99aa62 req-b996ba8d-9428-4923-9822-1c565a63b861 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Received unexpected event network-vif-plugged-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 for instance with vm_state active and task_state None.
Aug 16 12:42:37 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:42 user nova-compute[73520]: INFO nova.compute.manager [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Terminating instance
Aug 16 12:42:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-d2997c8d-3a76-44ff-995b-fdd6641b9374 req-76b30690-b4bf-4012-8246-324dddd4b700 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-unplugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d2997c8d-3a76-44ff-995b-fdd6641b9374 req-76b30690-b4bf-4012-8246-324dddd4b700 service nova] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d2997c8d-3a76-44ff-995b-fdd6641b9374 req-76b30690-b4bf-4012-8246-324dddd4b700 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d2997c8d-3a76-44ff-995b-fdd6641b9374 req-76b30690-b4bf-4012-8246-324dddd4b700 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-d2997c8d-3a76-44ff-995b-fdd6641b9374 req-76b30690-b4bf-4012-8246-324dddd4b700 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] No waiting events found dispatching network-vif-unplugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:42:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-d2997c8d-3a76-44ff-995b-fdd6641b9374 req-76b30690-b4bf-4012-8246-324dddd4b700 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-unplugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:42:43 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Instance destroyed successfully.
Aug 16 12:42:43 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'resources' on Instance uuid 26b0286b-9021-4859-88ac-760e7249a3d2 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:42:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1747553426',display_name='tempest-AttachVolumeTestJSON-server-1747553426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1747553426',id=42,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF2K5lPCqq45wlqWBJxOjnJMaqjiorbGycI/+zIIrQyDX2lqhtiNH0sOEH1miqoWIiFDFfI+JbhEvZIwSQ6ThAdNXntyvNLGxVlW0nvg7ZrlFK5UVMdROmd3/SoB5yrFw==',key_name='tempest-keypair-1911074579',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='446e9796da1f4303bb7d628fa8c8c3c3',ramdisk_id='',reservation_id='r-0o6wl00i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1174912644',owner_user_name='tempest-AttachVolumeTestJSON-1174912644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9ef4b48f36408eba035f0d7e277dcb',uuid=26b0286b-9021-4859-88ac-760e7249a3d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:42:43 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converting VIF {"id": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "address": "fa:16:3e:25:5f:15", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7cef18-ea", "ovs_interfaceid": "6e7cef18-ea49-45cb-a7e8-3e5292b6f48f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:42:43 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:42:43 user nova-compute[73520]: DEBUG os_vif [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:42:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e7cef18-ea, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:42:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:42:43 user nova-compute[73520]: INFO os_vif [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:5f:15,bridge_name='br-int',has_traffic_filtering=True,id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7cef18-ea')
Aug 16 12:42:43 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Deleting instance files /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2_del
Aug 16 12:42:43 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Deletion of /opt/stack/data/nova/instances/26b0286b-9021-4859-88ac-760e7249a3d2_del complete
Aug 16 12:42:43 user nova-compute[73520]: INFO nova.compute.manager [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 12:42:43 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:42:43 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:42:43 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:42:44 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:42:44 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Took 1.10 seconds to deallocate network for instance.
Aug 16 12:42:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-47c8ec98-a150-4a3a-b253-00b985c9e98f req-78ea25a1-2b61-4be0-895e-44b314d8d222 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-deleted-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:42:44 user nova-compute[73520]: INFO nova.compute.manager [req-47c8ec98-a150-4a3a-b253-00b985c9e98f req-78ea25a1-2b61-4be0-895e-44b314d8d222 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Neutron deleted interface 6e7cef18-ea49-45cb-a7e8-3e5292b6f48f; detaching it from the instance and deleting it from the info cache
Aug 16 12:42:44 user nova-compute[73520]: DEBUG nova.network.neutron [req-47c8ec98-a150-4a3a-b253-00b985c9e98f req-78ea25a1-2b61-4be0-895e-44b314d8d222 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:42:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-47c8ec98-a150-4a3a-b253-00b985c9e98f req-78ea25a1-2b61-4be0-895e-44b314d8d222 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Detach interface failed, port_id=6e7cef18-ea49-45cb-a7e8-3e5292b6f48f, reason: Instance 26b0286b-9021-4859-88ac-760e7249a3d2 could not be found. {{(pid=73520) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 12:42:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:44 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:42:44 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:42:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:44 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Deleted allocations for instance 26b0286b-9021-4859-88ac-760e7249a3d2
Aug 16 12:42:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d10feb84-1ad5-4578-a2c1-4b22c36e761a tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "26b0286b-9021-4859-88ac-760e7249a3d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.297s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-e244f7d5-4c23-4c27-bec6-18de3543d7e1 req-7ee24c17-6019-423b-a0db-dfac88935351 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:42:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e244f7d5-4c23-4c27-bec6-18de3543d7e1 req-7ee24c17-6019-423b-a0db-dfac88935351 service nova] Acquiring lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:42:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e244f7d5-4c23-4c27-bec6-18de3543d7e1 req-7ee24c17-6019-423b-a0db-dfac88935351 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:42:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e244f7d5-4c23-4c27-bec6-18de3543d7e1 req-7ee24c17-6019-423b-a0db-dfac88935351 service nova] Lock "26b0286b-9021-4859-88ac-760e7249a3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:42:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-e244f7d5-4c23-4c27-bec6-18de3543d7e1 req-7ee24c17-6019-423b-a0db-dfac88935351 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] No waiting events found dispatching network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:42:44 user nova-compute[73520]: WARNING nova.compute.manager [req-e244f7d5-4c23-4c27-bec6-18de3543d7e1 req-7ee24c17-6019-423b-a0db-dfac88935351 service nova] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Received unexpected event network-vif-plugged-6e7cef18-ea49-45cb-a7e8-3e5292b6f48f for instance with vm_state deleted and task_state None.
Aug 16 12:42:47 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:42:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:42:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:42:51 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:42:51 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:42:51 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:42:51 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:42:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:57 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:42:58 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189763.0339828, 26b0286b-9021-4859-88ac-760e7249a3d2 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:42:58 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] VM Stopped (Lifecycle Event)
Aug 16 12:42:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-14af7572-f2c1-460d-ae50-e795d926ed04 None None] [instance: 26b0286b-9021-4859-88ac-760e7249a3d2] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:42:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:42:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:01 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:43:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:43:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:43:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:43:01 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:43:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:03 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:43:03 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:43:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8388MB free_disk=25.282020568847656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d034d519-491c-4963-95b1-48eaf2d81653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 60f4612b-c0f5-499b-ac43-b644e7ee5cdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:43:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:43:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:04 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:43:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:43:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:43:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:43:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:43:05 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:43:05 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:43:05 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updating instance_info_cache with network_info: [{"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:43:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:43:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:43:05 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:43:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG nova.objects.instance [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'flavor' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:43:20 user nova-compute[73520]: INFO nova.compute.manager [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Attaching volume 72fefee0-b84c-47cf-9340-d79c1a5c5fa9 to /dev/vdb
Aug 16 12:43:20 user nova-compute[73520]: DEBUG os_brick.utils [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b04dfa-5932-4d96-a5dc-6439a7cdbc16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1792abe6-979a-42d9-b10b-cbb7a901d4e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3321a969-bb9c-4254-abbe-059f396c2882]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5018f60-39e3-440d-a713-e37a3576f487]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:43:20 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:43:20 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ac0056-ca43-4f1d-aaea-ff45bf4b2cce]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG os_brick.utils [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:43:20 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updating existing volume attachment record: 178b9521-5550-445a-9d5d-78f9f2a2771f {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:43:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:43:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:32 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:43:36 user nova-compute[73520]: INFO nova.compute.claims [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Claim successful on node user
Aug 16 12:43:36 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKAIgvkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:43:36 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:43:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:43:36 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:43:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:43:36 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG nova.network.neutron [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[967b7a74-ed64-48fb-aeba-df0e41e18d7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:43:36 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:36 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94537b7-2b0c-4262-9873-9494cb5f43c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9] added
Aug 16 12:43:36 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15bd0c9-c009-4520-a162-0aa472d0a965]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73c3d05-ea2f-4610-babe-d1458caf4dd0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKAIgvkp {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKAIgvkp" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[79412cfb-4ba9-47cd-bb47-563a6e624345]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PKAIgvkp'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG nova.policy [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df9ef4b48f36408eba035f0d7e277dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446e9796da1f4303bb7d628fa8c8c3c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7fff6d-dc2b-47bb-8eb8-db8248d43ddd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa6c06e-4235-494d-b608-8fcc3c9a7ad3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:43:37 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:43:37 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:43:37 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 12:43:37 user nova-compute[73520]: 
Aug 16 12:43:37 user nova-compute[73520]: DEBUG nova.compute.manager [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:43:37 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Creating image(s)
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "/opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "/opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d118346-70da-471d-82e6-f362cc665dd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9, portal: 172.16.0.220,3260]
Aug 16 12:43:37 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9, portal: 172.16.0.220,3260] successful.
Aug 16 12:43:37 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[468bd0ec-6495-4953-a154-131f7300db4f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9511a6-a0f9-4886-b0ec-c82cbe293feb]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 (non-flash)
Aug 16 12:43:37 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 (non-flash)
Aug 16 12:43:37 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4126d25b-d503-4547-a65a-9f4c1e4da069]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKAIgvkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk 1073741824" returned: 0 in 0.048s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG nova.network.neutron [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Successfully created port: 5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Cannot resize image /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'migration_context' on Instance uuid 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Ensure instance console log exists: /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:43:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26138623736616434', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138623736616434', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG nova.objects.instance [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'flavor' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:43:38 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:43:38 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:43:38 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:43:38 user nova-compute[73520]:   <serial>72fefee0-b84c-47cf-9340-d79c1a5c5fa9</serial>
Aug 16 12:43:38 user nova-compute[73520]: </disk>
Aug 16 12:43:38 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Successfully updated port: 5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "refresh_cache-7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquired lock "refresh_cache-7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG nova.network.neutron [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] No VIF found with MAC fa:16:3e:43:87:09, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-f59ca90d-0778-48e7-b3fa-5adf5121f9df req-c30d575c-4f94-424a-8284-dbe042e4e9c5 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received event network-changed-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG nova.compute.manager [req-f59ca90d-0778-48e7-b3fa-5adf5121f9df req-c30d575c-4f94-424a-8284-dbe042e4e9c5 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Refreshing instance network info cache due to event network-changed-5159786e-66a6-4cd9-86e8-40fb3c16f802. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f59ca90d-0778-48e7-b3fa-5adf5121f9df req-c30d575c-4f94-424a-8284-dbe042e4e9c5 service nova] Acquiring lock "refresh_cache-7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:43:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-21142d79-f111-4738-b8a6-002be81d132d tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.068s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.network.neutron [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Updating instance_info_cache with network_info: [{"id": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "address": "fa:16:3e:9b:fd:e0", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5159786e-66", "ovs_interfaceid": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Releasing lock "refresh_cache-7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.compute.manager [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Instance network_info: |[{"id": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "address": "fa:16:3e:9b:fd:e0", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5159786e-66", "ovs_interfaceid": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f59ca90d-0778-48e7-b3fa-5adf5121f9df req-c30d575c-4f94-424a-8284-dbe042e4e9c5 service nova] Acquired lock "refresh_cache-7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.network.neutron [req-f59ca90d-0778-48e7-b3fa-5adf5121f9df req-c30d575c-4f94-424a-8284-dbe042e4e9c5 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Refreshing network info cache for port 5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Start _get_guest_xml network_info=[{"id": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "address": "fa:16:3e:9b:fd:e0", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5159786e-66", "ovs_interfaceid": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:43:39 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:43:39 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1288359729',display_name='tempest-AttachVolumeTestJSON-server-1288359729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1288359729',id=49,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEQbCTLuT1N+j1n44RpE5DoJpA71qMJUxatBnzH0Kbai2kC/L1yUPxBH+YuE5RTJbQB5Wm7BsRkfYFkHw/+UHMhsKMBsK2oGzEce5IpHCT3rMcUYFTnAWTLAcFq18TBBg==',key_name='tempest-keypair-1327296775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446e9796da1f4303bb7d628fa8c8c3c3',ramdisk_id='',reservation_id='r-g151ecw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1174912644',owner_user_name='tempest-AttachVolumeTestJSON-1174912644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9ef4b48f36408eba035f0d7e277dcb',uuid=7a2f41a1-de0d-49df-a9a0-b518bf3c0f70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "address": "fa:16:3e:9b:fd:e0", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5159786e-66", "ovs_interfaceid": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converting VIF {"id": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "address": "fa:16:3e:9b:fd:e0", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5159786e-66", "ovs_interfaceid": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5159786e-66a6-4cd9-86e8-40fb3c16f802,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5159786e-66') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.objects.instance [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:43:39 user nova-compute[73520]:   <uuid>7a2f41a1-de0d-49df-a9a0-b518bf3c0f70</uuid>
Aug 16 12:43:39 user nova-compute[73520]:   <name>instance-00000031</name>
Aug 16 12:43:39 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:43:39 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:43:39 user nova-compute[73520]:   <metadata>
Aug 16 12:43:39 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:43:39 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:43:39 user nova-compute[73520]:       <nova:name>tempest-AttachVolumeTestJSON-server-1288359729</nova:name>
Aug 16 12:43:39 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:43:39</nova:creationTime>
Aug 16 12:43:39 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:43:39 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:43:39 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:43:39 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:43:39 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:43:39 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:43:39 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:43:39 user nova-compute[73520]:       <nova:owner>
Aug 16 12:43:39 user nova-compute[73520]:         <nova:user uuid="df9ef4b48f36408eba035f0d7e277dcb">tempest-AttachVolumeTestJSON-1174912644-project-member</nova:user>
Aug 16 12:43:39 user nova-compute[73520]:         <nova:project uuid="446e9796da1f4303bb7d628fa8c8c3c3">tempest-AttachVolumeTestJSON-1174912644</nova:project>
Aug 16 12:43:39 user nova-compute[73520]:       </nova:owner>
Aug 16 12:43:39 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 12:43:39 user nova-compute[73520]:       <nova:ports>
Aug 16 12:43:39 user nova-compute[73520]:         <nova:port uuid="5159786e-66a6-4cd9-86e8-40fb3c16f802">
Aug 16 12:43:39 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 12:43:39 user nova-compute[73520]:         </nova:port>
Aug 16 12:43:39 user nova-compute[73520]:       </nova:ports>
Aug 16 12:43:39 user nova-compute[73520]:     </nova:instance>
Aug 16 12:43:39 user nova-compute[73520]:   </metadata>
Aug 16 12:43:39 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:43:39 user nova-compute[73520]:     <system>
Aug 16 12:43:39 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:43:39 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:43:39 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:43:39 user nova-compute[73520]:       <entry name="serial">7a2f41a1-de0d-49df-a9a0-b518bf3c0f70</entry>
Aug 16 12:43:39 user nova-compute[73520]:       <entry name="uuid">7a2f41a1-de0d-49df-a9a0-b518bf3c0f70</entry>
Aug 16 12:43:39 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:43:39 user nova-compute[73520]:     </system>
Aug 16 12:43:39 user nova-compute[73520]:   </sysinfo>
Aug 16 12:43:39 user nova-compute[73520]:   <os>
Aug 16 12:43:39 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:43:39 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:43:39 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:43:39 user nova-compute[73520]:   </os>
Aug 16 12:43:39 user nova-compute[73520]:   <features>
Aug 16 12:43:39 user nova-compute[73520]:     <acpi/>
Aug 16 12:43:39 user nova-compute[73520]:     <apic/>
Aug 16 12:43:39 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:43:39 user nova-compute[73520]:   </features>
Aug 16 12:43:39 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:43:39 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:43:39 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:43:39 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:43:39 user nova-compute[73520]:   </clock>
Aug 16 12:43:39 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:43:39 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:43:39 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:43:39 user nova-compute[73520]:   </cpu>
Aug 16 12:43:39 user nova-compute[73520]:   <devices>
Aug 16 12:43:39 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:43:39 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:43:39 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk"/>
Aug 16 12:43:39 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:43:39 user nova-compute[73520]:     </disk>
Aug 16 12:43:39 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:43:39 user nova-compute[73520]:       <mac address="fa:16:3e:9b:fd:e0"/>
Aug 16 12:43:39 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:43:39 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:43:39 user nova-compute[73520]:       <target dev="tap5159786e-66"/>
Aug 16 12:43:39 user nova-compute[73520]:     </interface>
Aug 16 12:43:39 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:43:39 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/console.log" append="off"/>
Aug 16 12:43:39 user nova-compute[73520]:     </serial>
Aug 16 12:43:39 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:43:39 user nova-compute[73520]:     <video>
Aug 16 12:43:39 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:43:39 user nova-compute[73520]:     </video>
Aug 16 12:43:39 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:43:39 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:43:39 user nova-compute[73520]:     </rng>
Aug 16 12:43:39 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:43:39 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:43:39 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:43:39 user nova-compute[73520]:     </memballoon>
Aug 16 12:43:39 user nova-compute[73520]:   </devices>
Aug 16 12:43:39 user nova-compute[73520]: </domain>
Aug 16 12:43:39 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1288359729',display_name='tempest-AttachVolumeTestJSON-server-1288359729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1288359729',id=49,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEQbCTLuT1N+j1n44RpE5DoJpA71qMJUxatBnzH0Kbai2kC/L1yUPxBH+YuE5RTJbQB5Wm7BsRkfYFkHw/+UHMhsKMBsK2oGzEce5IpHCT3rMcUYFTnAWTLAcFq18TBBg==',key_name='tempest-keypair-1327296775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446e9796da1f4303bb7d628fa8c8c3c3',ramdisk_id='',reservation_id='r-g151ecw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1174912644',owner_user_name='tempest-AttachVolumeTestJSON-1174912644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9ef4b48f36408eba035f0d7e277dcb',uuid=7a2f41a1-de0d-49df-a9a0-b518bf3c0f70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "address": "fa:16:3e:9b:fd:e0", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5159786e-66", "ovs_interfaceid": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converting VIF {"id": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "address": "fa:16:3e:9b:fd:e0", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5159786e-66", "ovs_interfaceid": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5159786e-66a6-4cd9-86e8-40fb3c16f802,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5159786e-66') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG os_vif [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5159786e-66a6-4cd9-86e8-40fb3c16f802,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5159786e-66') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5159786e-66, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5159786e-66, col_values=(('external_ids', {'iface-id': '5159786e-66a6-4cd9-86e8-40fb3c16f802', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:fd:e0', 'vm-uuid': '7a2f41a1-de0d-49df-a9a0-b518bf3c0f70'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:39 user nova-compute[73520]: INFO os_vif [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5159786e-66a6-4cd9-86e8-40fb3c16f802,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5159786e-66')
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No VIF found with MAC fa:16:3e:9b:fd:e0, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.network.neutron [req-f59ca90d-0778-48e7-b3fa-5adf5121f9df req-c30d575c-4f94-424a-8284-dbe042e4e9c5 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Updated VIF entry in instance network info cache for port 5159786e-66a6-4cd9-86e8-40fb3c16f802. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG nova.network.neutron [req-f59ca90d-0778-48e7-b3fa-5adf5121f9df req-c30d575c-4f94-424a-8284-dbe042e4e9c5 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Updating instance_info_cache with network_info: [{"id": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "address": "fa:16:3e:9b:fd:e0", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5159786e-66", "ovs_interfaceid": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:43:39 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f59ca90d-0778-48e7-b3fa-5adf5121f9df req-c30d575c-4f94-424a-8284-dbe042e4e9c5 service nova] Releasing lock "refresh_cache-7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:43:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-95b5ac7d-cedd-42ef-9f6f-7398a97e55b9 req-572eaade-9357-43e8-a009-a3d6ebe42b46 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received event network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:43:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-95b5ac7d-cedd-42ef-9f6f-7398a97e55b9 req-572eaade-9357-43e8-a009-a3d6ebe42b46 service nova] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:43:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-95b5ac7d-cedd-42ef-9f6f-7398a97e55b9 req-572eaade-9357-43e8-a009-a3d6ebe42b46 service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:43:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-95b5ac7d-cedd-42ef-9f6f-7398a97e55b9 req-572eaade-9357-43e8-a009-a3d6ebe42b46 service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:43:40 user nova-compute[73520]: DEBUG nova.compute.manager [req-95b5ac7d-cedd-42ef-9f6f-7398a97e55b9 req-572eaade-9357-43e8-a009-a3d6ebe42b46 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] No waiting events found dispatching network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:43:40 user nova-compute[73520]: WARNING nova.compute.manager [req-95b5ac7d-cedd-42ef-9f6f-7398a97e55b9 req-572eaade-9357-43e8-a009-a3d6ebe42b46 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received unexpected event network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 for instance with vm_state building and task_state spawning.
Aug 16 12:43:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:43:41 user nova-compute[73520]: INFO nova.compute.manager [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Detaching volume 72fefee0-b84c-47cf-9340-d79c1a5c5fa9
Aug 16 12:43:41 user nova-compute[73520]: INFO nova.virt.block_device [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Attempting to driver detach volume 72fefee0-b84c-47cf-9340-d79c1a5c5fa9 from mountpoint /dev/vdb
Aug 16 12:43:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Attempting to detach device vdb from instance d034d519-491c-4963-95b1-48eaf2d81653 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:43:41 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:43:41 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:43:41 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:43:41 user nova-compute[73520]:   <serial>72fefee0-b84c-47cf-9340-d79c1a5c5fa9</serial>
Aug 16 12:43:41 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:43:41 user nova-compute[73520]: </disk>
Aug 16 12:43:41 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:43:41 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Successfully detached device vdb from instance d034d519-491c-4963-95b1-48eaf2d81653 from the persistent domain config.
Aug 16 12:43:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d034d519-491c-4963-95b1-48eaf2d81653 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:43:41 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:43:41 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:43:41 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:43:41 user nova-compute[73520]:   <serial>72fefee0-b84c-47cf-9340-d79c1a5c5fa9</serial>
Aug 16 12:43:41 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:43:41 user nova-compute[73520]: </disk>
Aug 16 12:43:41 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692189821.9329307, d034d519-491c-4963-95b1-48eaf2d81653 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:43:41 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Successfully detached device vdb from instance d034d519-491c-4963-95b1-48eaf2d81653 from the live domain config.
Aug 16 12:43:41 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKAIgvkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:43:41 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:43:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[27028768-e0a2-4b9d-b3ee-94e8169c50c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[62343604-36d0-434b-bade-8afdc34a35cb]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 (non-flash)
Aug 16 12:43:41 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 (non-flash)
Aug 16 12:43:41 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c452560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:43:41 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8771d373-c322-4c13-9501-24e8598a8380]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eec317-ad79-4ede-ac07-cb86bb72e21e]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa79a27-db8d-4416-b2d1-6f4e297c25ab]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b029d059-618f-405b-a165-0310caadfb16]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc471c8-5001-4ff3-9907-ed6d7ce061d8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4819cbc-33be-4a53-9390-a3cb61f88f43]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9, portal: 172.16.0.220,3260]
Aug 16 12:43:42 user nova-compute[73520]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9, portal: 172.16.0.220,3260] successful.
Aug 16 12:43:42 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fefee0-b84c-47cf-9340-d79c1a5c5fa9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[09971ab3-944e-4651-a769-1c6f35417786]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] <== disconnect_volume: return (255ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189822.7958, 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:43:42 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] VM Resumed (Lifecycle Event)
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:43:42 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Instance spawned successfully.
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:43:42 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189822.7989829, 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:43:42 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] VM Started (Lifecycle Event)
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-b38fb403-840f-462e-82cc-55f0dab8df7a req-110f9391-0888-4b1c-9b9f-9db570b70e58 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received event network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b38fb403-840f-462e-82cc-55f0dab8df7a req-110f9391-0888-4b1c-9b9f-9db570b70e58 service nova] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b38fb403-840f-462e-82cc-55f0dab8df7a req-110f9391-0888-4b1c-9b9f-9db570b70e58 service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-b38fb403-840f-462e-82cc-55f0dab8df7a req-110f9391-0888-4b1c-9b9f-9db570b70e58 service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-b38fb403-840f-462e-82cc-55f0dab8df7a req-110f9391-0888-4b1c-9b9f-9db570b70e58 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] No waiting events found dispatching network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:43:42 user nova-compute[73520]: WARNING nova.compute.manager [req-b38fb403-840f-462e-82cc-55f0dab8df7a req-110f9391-0888-4b1c-9b9f-9db570b70e58 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received unexpected event network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 for instance with vm_state building and task_state spawning.
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:43:42 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:43:42 user nova-compute[73520]: INFO nova.compute.manager [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 16 12:43:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:43:43 user nova-compute[73520]: INFO nova.compute.manager [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Took 6.46 seconds to build instance.
Aug 16 12:43:43 user nova-compute[73520]: DEBUG nova.objects.instance [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'flavor' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:43:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-e9bb6765-c206-4e2e-b6d7-c0e03d25e331 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.554s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:43:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0c6830b3-8eca-4d13-bb91-df859596580e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.620s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:43:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:43:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:43:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:43:51 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:43:52 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:43:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:43:53 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:43:53 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:43:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:43:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:43:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:43:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:01 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:44:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:44:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:44:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:44:01 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Acquiring lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Acquiring lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:44:02 user nova-compute[73520]: INFO nova.compute.manager [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Terminating instance
Aug 16 12:44:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-27b28046-77ee-491c-bc42-c1ec959e581e req-d35ccb1a-0216-4bf0-8d80-3478d04b4c3e service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Received event network-vif-unplugged-8b3afb06-3457-47a1-ae05-b32343f794a8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-27b28046-77ee-491c-bc42-c1ec959e581e req-d35ccb1a-0216-4bf0-8d80-3478d04b4c3e service nova] Acquiring lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-27b28046-77ee-491c-bc42-c1ec959e581e req-d35ccb1a-0216-4bf0-8d80-3478d04b4c3e service nova] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-27b28046-77ee-491c-bc42-c1ec959e581e req-d35ccb1a-0216-4bf0-8d80-3478d04b4c3e service nova] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-27b28046-77ee-491c-bc42-c1ec959e581e req-d35ccb1a-0216-4bf0-8d80-3478d04b4c3e service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] No waiting events found dispatching network-vif-unplugged-8b3afb06-3457-47a1-ae05-b32343f794a8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG nova.compute.manager [req-27b28046-77ee-491c-bc42-c1ec959e581e req-d35ccb1a-0216-4bf0-8d80-3478d04b4c3e service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Received event network-vif-unplugged-8b3afb06-3457-47a1-ae05-b32343f794a8 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:03 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Instance destroyed successfully.
Aug 16 12:44:03 user nova-compute[73520]: DEBUG nova.objects.instance [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lazy-loading 'resources' on Instance uuid 60f4612b-c0f5-499b-ac43-b644e7ee5cdd {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-287860474',display_name='tempest-VolumesNegativeTest-instance-287860474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-287860474',id=47,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:42:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbbb89fe54af4b05b1d1a0c8de3d3129',ramdisk_id='',reservation_id='r-yk53v8wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1554593110',owner_user_name='tempest-VolumesNegativeTest-1554593110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:42:23Z,user_data=None,user_id='6f0c2a474bde4ea69504beacffa8c532',uuid=60f4612b-c0f5-499b-ac43-b644e7ee5cdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b3afb06-3457-47a1-ae05-b32343f794a8", "address": "fa:16:3e:70:07:c8", "network": {"id": "8b1b66b1-8966-424e-8ed8-6592a4467faf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c36b9057d00349558c96f16d77c55ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3afb06-34", "ovs_interfaceid": "8b3afb06-3457-47a1-ae05-b32343f794a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Converting VIF {"id": "8b3afb06-3457-47a1-ae05-b32343f794a8", "address": "fa:16:3e:70:07:c8", "network": {"id": "8b1b66b1-8966-424e-8ed8-6592a4467faf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c36b9057d00349558c96f16d77c55ab2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b3afb06-34", "ovs_interfaceid": "8b3afb06-3457-47a1-ae05-b32343f794a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:07:c8,bridge_name='br-int',has_traffic_filtering=True,id=8b3afb06-3457-47a1-ae05-b32343f794a8,network=Network(8b1b66b1-8966-424e-8ed8-6592a4467faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3afb06-34') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG os_vif [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:07:c8,bridge_name='br-int',has_traffic_filtering=True,id=8b3afb06-3457-47a1-ae05-b32343f794a8,network=Network(8b1b66b1-8966-424e-8ed8-6592a4467faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3afb06-34') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b3afb06-34, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:44:03 user nova-compute[73520]: INFO os_vif [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:07:c8,bridge_name='br-int',has_traffic_filtering=True,id=8b3afb06-3457-47a1-ae05-b32343f794a8,network=Network(8b1b66b1-8966-424e-8ed8-6592a4467faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b3afb06-34')
Aug 16 12:44:03 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Deleting instance files /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd_del
Aug 16 12:44:03 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Deletion of /opt/stack/data/nova/instances/60f4612b-c0f5-499b-ac43-b644e7ee5cdd_del complete
Aug 16 12:44:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:03 user nova-compute[73520]: INFO nova.compute.manager [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 12:44:03 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:44:03 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:44:04 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:44:04 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8359MB free_disk=25.25295639038086GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d034d519-491c-4963-95b1-48eaf2d81653 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 60f4612b-c0f5-499b-ac43-b644e7ee5cdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing inventories for resource provider 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating ProviderTree inventory for provider 70dde5f5-9594-47c3-954e-598dd3089747 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing aggregate associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, aggregates: None {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing trait associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:44:04 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Took 1.12 seconds to deallocate network for instance.
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.compute.manager [req-891b627c-91b9-4510-affa-3ae47ba84a4f req-71a62c72-fdff-4ac0-8fdf-9231f28b2501 service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Received event network-vif-deleted-8b3afb06-3457-47a1-ae05-b32343f794a8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:44:04 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:44:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:44:05 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Deleted allocations for instance 60f4612b-c0f5-499b-ac43-b644e7ee5cdd
Aug 16 12:44:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-c3b1fd30-3aea-4b76-82b5-1daa43b5df8f tempest-VolumesNegativeTest-1554593110 tempest-VolumesNegativeTest-1554593110-project-member] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:44:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-ff1e3c06-95c7-4ce4-8b07-b4b785cc8758 req-de265c15-1333-477c-8e1a-0db8d93e70e5 service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Received event network-vif-plugged-8b3afb06-3457-47a1-ae05-b32343f794a8 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:44:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ff1e3c06-95c7-4ce4-8b07-b4b785cc8758 req-de265c15-1333-477c-8e1a-0db8d93e70e5 service nova] Acquiring lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:44:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ff1e3c06-95c7-4ce4-8b07-b4b785cc8758 req-de265c15-1333-477c-8e1a-0db8d93e70e5 service nova] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:44:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ff1e3c06-95c7-4ce4-8b07-b4b785cc8758 req-de265c15-1333-477c-8e1a-0db8d93e70e5 service nova] Lock "60f4612b-c0f5-499b-ac43-b644e7ee5cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:44:05 user nova-compute[73520]: DEBUG nova.compute.manager [req-ff1e3c06-95c7-4ce4-8b07-b4b785cc8758 req-de265c15-1333-477c-8e1a-0db8d93e70e5 service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] No waiting events found dispatching network-vif-plugged-8b3afb06-3457-47a1-ae05-b32343f794a8 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:44:05 user nova-compute[73520]: WARNING nova.compute.manager [req-ff1e3c06-95c7-4ce4-8b07-b4b785cc8758 req-de265c15-1333-477c-8e1a-0db8d93e70e5 service nova] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Received unexpected event network-vif-plugged-8b3afb06-3457-47a1-ae05-b32343f794a8 for instance with vm_state deleted and task_state None.
Aug 16 12:44:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:44:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:44:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:44:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:44:06 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:44:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updating instance_info_cache with network_info: [{"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:44:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:44:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:44:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:09 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:44:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 12:44:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] There are 0 instances to clean {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 12:44:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:17 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:44:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 12:44:18 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189843.5612197, 60f4612b-c0f5-499b-ac43-b644e7ee5cdd => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:44:18 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] VM Stopped (Lifecycle Event)
Aug 16 12:44:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-9650d3e5-2773-4388-b13c-00648dabc644 None None] [instance: 60f4612b-c0f5-499b-ac43-b644e7ee5cdd] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:44:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-242df746-a71e-4751-8244-15b6fa2d5b61 req-a7bb251a-95aa-4fb4-b414-84f4294ef5cf service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Received event network-changed-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-242df746-a71e-4751-8244-15b6fa2d5b61 req-a7bb251a-95aa-4fb4-b414-84f4294ef5cf service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Refreshing instance network info cache due to event network-changed-452f5c2d-20dc-4ac6-b875-a200d55f0cc0. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-242df746-a71e-4751-8244-15b6fa2d5b61 req-a7bb251a-95aa-4fb4-b414-84f4294ef5cf service nova] Acquiring lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-242df746-a71e-4751-8244-15b6fa2d5b61 req-a7bb251a-95aa-4fb4-b414-84f4294ef5cf service nova] Acquired lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG nova.network.neutron [req-242df746-a71e-4751-8244-15b6fa2d5b61 req-a7bb251a-95aa-4fb4-b414-84f4294ef5cf service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Refreshing network info cache for port 452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG nova.network.neutron [req-242df746-a71e-4751-8244-15b6fa2d5b61 req-a7bb251a-95aa-4fb4-b414-84f4294ef5cf service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updated VIF entry in instance network info cache for port 452f5c2d-20dc-4ac6-b875-a200d55f0cc0. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG nova.network.neutron [req-242df746-a71e-4751-8244-15b6fa2d5b61 req-a7bb251a-95aa-4fb4-b414-84f4294ef5cf service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updating instance_info_cache with network_info: [{"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lazy-loading 'flavor' on Instance uuid 38a325f8-e3cc-4033-92dd-dd47b6b4190c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-242df746-a71e-4751-8244-15b6fa2d5b61 req-a7bb251a-95aa-4fb4-b414-84f4294ef5cf service nova] Releasing lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:44:21 user nova-compute[73520]: INFO nova.compute.manager [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Attaching volume c56061b0-63ac-46ab-adf4-7a4d345c27f2 to /dev/vdb
Aug 16 12:44:21 user nova-compute[73520]: DEBUG os_brick.utils [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c2efcb-0b9a-4dfb-a51d-6326399b4fbe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[13523eab-8ad3-4af1-89f0-04b2fe2d3097]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c75f55a-39a6-463c-a933-abfc22f2c831]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7307a299-7f84-4c39-92d7-d9528a9acf6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:44:22 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:44:22 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5f080a-fd1e-47ba-b8fb-0ad875cd9144]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG os_brick.utils [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:44:22 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updating existing volume attachment record: 388b3da5-9ba7-47fb-b79e-a77ce1afaef0 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:44:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:44:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phWlHLew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:44:31 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:44:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:44:31 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:44:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:44:31 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7532788e-31b5-4f34-ba3b-3a10594111c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:44:31 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad28df3e-5587-438b-bd1f-7c79d14401e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2] added
Aug 16 12:44:31 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[469923b1-d4cc-47cd-94c0-ef98485a09c7]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[089299aa-ed81-4c36-84fb-ac00457647a2]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v phWlHLew {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v phWlHLew" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2233e0-4c65-44f9-8a4f-3915baafe236]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'phWlHLew'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce85ea74-c752-4aab-9305-214fe282c2b4]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c892b0c-526b-4e5e-8a68-a1aa84337f1f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:44:31 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:44:31 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:44:31 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:44:31 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 12:44:31 user nova-compute[73520]: 
Aug 16 12:44:31 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b94d824-d3a3-463e-99cb-e800ed6370eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2, portal: 172.16.0.220,3260]
Aug 16 12:44:32 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2, portal: 172.16.0.220,3260] successful.
Aug 16 12:44:32 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca50750-c08e-43a1-a7db-53235bbf3e1f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5fe403-8f8c-4ed4-a559-c184e0f78c13]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 (non-flash)
Aug 16 12:44:32 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 (non-flash)
Aug 16 12:44:32 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0518d60-dc0a-49bd-a196-4346ea12e22b]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:44:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phWlHLew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:44:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:44:33 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26662366639613136', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:44:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662366639613136', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:44:33 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lazy-loading 'flavor' on Instance uuid 38a325f8-e3cc-4033-92dd-dd47b6b4190c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:44:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:44:33 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:44:33 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:44:33 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:44:33 user nova-compute[73520]:   <serial>c56061b0-63ac-46ab-adf4-7a4d345c27f2</serial>
Aug 16 12:44:33 user nova-compute[73520]: </disk>
Aug 16 12:44:33 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:44:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:44:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:44:33 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] No VIF found with MAC fa:16:3e:51:75:76, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:44:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:33 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f7d9322c-a19b-40a5-ac4b-02d316399a42 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.802s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:44:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:44:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:44:36 user nova-compute[73520]: INFO nova.compute.manager [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Detaching volume c56061b0-63ac-46ab-adf4-7a4d345c27f2
Aug 16 12:44:36 user nova-compute[73520]: INFO nova.virt.block_device [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Attempting to driver detach volume c56061b0-63ac-46ab-adf4-7a4d345c27f2 from mountpoint /dev/vdb
Aug 16 12:44:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Attempting to detach device vdb from instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:44:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:44:36 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:44:36 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:44:36 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:44:36 user nova-compute[73520]:   <serial>c56061b0-63ac-46ab-adf4-7a4d345c27f2</serial>
Aug 16 12:44:36 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:44:36 user nova-compute[73520]: </disk>
Aug 16 12:44:36 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:44:36 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Successfully detached device vdb from instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c from the persistent domain config.
Aug 16 12:44:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:44:36 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:44:36 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:44:36 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:44:36 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:44:36 user nova-compute[73520]:   <serial>c56061b0-63ac-46ab-adf4-7a4d345c27f2</serial>
Aug 16 12:44:36 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:44:36 user nova-compute[73520]: </disk>
Aug 16 12:44:36 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692189877.0178661, 38a325f8-e3cc-4033-92dd-dd47b6b4190c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:44:37 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Successfully detached device vdb from instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c from the live domain config.
Aug 16 12:44:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phWlHLew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:44:37 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[956486db-c20f-49ac-838b-48902bbeddc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dab5e7-b1ec-4322-8e33-5f753bd0ed6e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 (non-flash)
Aug 16 12:44:37 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 (non-flash)
Aug 16 12:44:37 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c770160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dcd0d7-bfc5-451f-b752-c90bcf636cb4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9906f6e-87de-4f16-b8cc-29c720fbfa21]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e95209b-24ff-4c21-bb93-ee9a468569b3]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe72cd0-e099-4a4b-895c-09629c142992]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9dea7b-4133-4958-9728-cb2e8a0d4899]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[00502be8-d108-4bf1-a142-227a80c3c637]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2, portal: 172.16.0.220,3260]
Aug 16 12:44:37 user nova-compute[73520]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2, portal: 172.16.0.220,3260] successful.
Aug 16 12:44:37 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56061b0-63ac-46ab-adf4-7a4d345c27f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cc9859-6a11-4903-b5a7-736730c2170f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] <== disconnect_volume: return (268ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:44:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:44:38 user nova-compute[73520]: DEBUG nova.objects.instance [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lazy-loading 'flavor' on Instance uuid 38a325f8-e3cc-4033-92dd-dd47b6b4190c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:44:38 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1a8b21a8-2b95-4d61-8b1f-2d7cdd463d73 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.850s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:44:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:44:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:44:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:44:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:44:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:44:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:44:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:44:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:44:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:44:53 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:44:53 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:44:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:44:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:44:55 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:44:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:44:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:45:01 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:45:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:01 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:45:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:03 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:45:03 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:45:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8480MB free_disk=25.269527435302734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance d034d519-491c-4963-95b1-48eaf2d81653 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:45:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:07 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:45:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:45:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:45:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:45:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:45:08 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:45:08 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:45:08 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updating instance_info_cache with network_info: [{"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:45:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-d034d519-491c-4963-95b1-48eaf2d81653" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:45:08 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:45:09 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:45:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:45:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:13 user nova-compute[73520]: INFO nova.compute.manager [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Terminating instance
Aug 16 12:45:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:45:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-7c03f6cb-f3a8-4da0-a9cc-d3c8f5405689 req-083714fa-f020-44a2-b32d-621374149991 service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Received event network-vif-unplugged-63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7c03f6cb-f3a8-4da0-a9cc-d3c8f5405689 req-083714fa-f020-44a2-b32d-621374149991 service nova] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7c03f6cb-f3a8-4da0-a9cc-d3c8f5405689 req-083714fa-f020-44a2-b32d-621374149991 service nova] Lock "d034d519-491c-4963-95b1-48eaf2d81653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7c03f6cb-f3a8-4da0-a9cc-d3c8f5405689 req-083714fa-f020-44a2-b32d-621374149991 service nova] Lock "d034d519-491c-4963-95b1-48eaf2d81653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-7c03f6cb-f3a8-4da0-a9cc-d3c8f5405689 req-083714fa-f020-44a2-b32d-621374149991 service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] No waiting events found dispatching network-vif-unplugged-63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-7c03f6cb-f3a8-4da0-a9cc-d3c8f5405689 req-083714fa-f020-44a2-b32d-621374149991 service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Received event network-vif-unplugged-63a2fe18-23e4-4eaa-9a52-aab734ec0bec for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:45:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Instance destroyed successfully.
Aug 16 12:45:14 user nova-compute[73520]: DEBUG nova.objects.instance [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lazy-loading 'resources' on Instance uuid d034d519-491c-4963-95b1-48eaf2d81653 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:37:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1058091349',display_name='tempest-SnapshotDataIntegrityTests-server-1058091349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1058091349',id=46,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBae3l9iLlsGkBww5Z1lclD3whXbmjd0jQKRjFfgHZ/M6kcOBSGzvQqtVGBcJXjXA+KR1rJhjITUfDBxU+yjDBP/1UbYMFwAXxAZ6bxxsjbiZX1fX7xUas7La1066XABOQ==',key_name='tempest-keypair-1504047710',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:37:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3065df22890945b8a961dc7211e3b6dc',ramdisk_id='',reservation_id='r-hp0iu66j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-353803011',owner_user_name='tempest-SnapshotDataIntegrityTests-353803011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:37:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5834b6ba9f04a3ebf076c36aabb4af5',uuid=d034d519-491c-4963-95b1-48eaf2d81653,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Converting VIF {"id": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "address": "fa:16:3e:43:87:09", "network": {"id": "ab8bdcaf-fbd4-4773-91f3-43d287f12d7b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1037118830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3065df22890945b8a961dc7211e3b6dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a2fe18-23", "ovs_interfaceid": "63a2fe18-23e4-4eaa-9a52-aab734ec0bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:87:09,bridge_name='br-int',has_traffic_filtering=True,id=63a2fe18-23e4-4eaa-9a52-aab734ec0bec,network=Network(ab8bdcaf-fbd4-4773-91f3-43d287f12d7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a2fe18-23') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG os_vif [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:87:09,bridge_name='br-int',has_traffic_filtering=True,id=63a2fe18-23e4-4eaa-9a52-aab734ec0bec,network=Network(ab8bdcaf-fbd4-4773-91f3-43d287f12d7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a2fe18-23') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63a2fe18-23, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:45:14 user nova-compute[73520]: INFO os_vif [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:87:09,bridge_name='br-int',has_traffic_filtering=True,id=63a2fe18-23e4-4eaa-9a52-aab734ec0bec,network=Network(ab8bdcaf-fbd4-4773-91f3-43d287f12d7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a2fe18-23')
Aug 16 12:45:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Deleting instance files /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653_del
Aug 16 12:45:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Deletion of /opt/stack/data/nova/instances/d034d519-491c-4963-95b1-48eaf2d81653_del complete
Aug 16 12:45:14 user nova-compute[73520]: INFO nova.compute.manager [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 16 12:45:14 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:45:14 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: d034d519-491c-4963-95b1-48eaf2d81653] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:45:16 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:45:16 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Took 1.37 seconds to deallocate network for instance.
Aug 16 12:45:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-ab8acabf-a676-402d-a386-4c3a02f4b750 req-04332f9b-ac45-4ea6-a0a8-b118c43ae3ab service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Received event network-vif-plugged-63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:45:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ab8acabf-a676-402d-a386-4c3a02f4b750 req-04332f9b-ac45-4ea6-a0a8-b118c43ae3ab service nova] Acquiring lock "d034d519-491c-4963-95b1-48eaf2d81653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ab8acabf-a676-402d-a386-4c3a02f4b750 req-04332f9b-ac45-4ea6-a0a8-b118c43ae3ab service nova] Lock "d034d519-491c-4963-95b1-48eaf2d81653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ab8acabf-a676-402d-a386-4c3a02f4b750 req-04332f9b-ac45-4ea6-a0a8-b118c43ae3ab service nova] Lock "d034d519-491c-4963-95b1-48eaf2d81653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-ab8acabf-a676-402d-a386-4c3a02f4b750 req-04332f9b-ac45-4ea6-a0a8-b118c43ae3ab service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] No waiting events found dispatching network-vif-plugged-63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:45:16 user nova-compute[73520]: WARNING nova.compute.manager [req-ab8acabf-a676-402d-a386-4c3a02f4b750 req-04332f9b-ac45-4ea6-a0a8-b118c43ae3ab service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Received unexpected event network-vif-plugged-63a2fe18-23e4-4eaa-9a52-aab734ec0bec for instance with vm_state deleted and task_state None.
Aug 16 12:45:16 user nova-compute[73520]: DEBUG nova.compute.manager [req-ab8acabf-a676-402d-a386-4c3a02f4b750 req-04332f9b-ac45-4ea6-a0a8-b118c43ae3ab service nova] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Received event network-vif-deleted-63a2fe18-23e4-4eaa-9a52-aab734ec0bec {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:45:16 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:45:16 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:45:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:16 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Deleted allocations for instance d034d519-491c-4963-95b1-48eaf2d81653
Aug 16 12:45:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-512dadaa-4510-4acb-90b7-532cdfcdb90e tempest-SnapshotDataIntegrityTests-353803011 tempest-SnapshotDataIntegrityTests-353803011-project-member] Lock "d034d519-491c-4963-95b1-48eaf2d81653" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.706s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:45:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-25403303-1c63-499f-b7ee-d7ad9e8fd14f req-216274d5-ef50-442a-beb7-29d10012de17 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received event network-changed-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:45:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-25403303-1c63-499f-b7ee-d7ad9e8fd14f req-216274d5-ef50-442a-beb7-29d10012de17 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Refreshing instance network info cache due to event network-changed-5159786e-66a6-4cd9-86e8-40fb3c16f802. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:45:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-25403303-1c63-499f-b7ee-d7ad9e8fd14f req-216274d5-ef50-442a-beb7-29d10012de17 service nova] Acquiring lock "refresh_cache-7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:45:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-25403303-1c63-499f-b7ee-d7ad9e8fd14f req-216274d5-ef50-442a-beb7-29d10012de17 service nova] Acquired lock "refresh_cache-7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:45:28 user nova-compute[73520]: DEBUG nova.network.neutron [req-25403303-1c63-499f-b7ee-d7ad9e8fd14f req-216274d5-ef50-442a-beb7-29d10012de17 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Refreshing network info cache for port 5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:45:28 user nova-compute[73520]: DEBUG nova.network.neutron [req-25403303-1c63-499f-b7ee-d7ad9e8fd14f req-216274d5-ef50-442a-beb7-29d10012de17 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Updated VIF entry in instance network info cache for port 5159786e-66a6-4cd9-86e8-40fb3c16f802. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:45:28 user nova-compute[73520]: DEBUG nova.network.neutron [req-25403303-1c63-499f-b7ee-d7ad9e8fd14f req-216274d5-ef50-442a-beb7-29d10012de17 service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Updating instance_info_cache with network_info: [{"id": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "address": "fa:16:3e:9b:fd:e0", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5159786e-66", "ovs_interfaceid": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:45:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-25403303-1c63-499f-b7ee-d7ad9e8fd14f req-216274d5-ef50-442a-beb7-29d10012de17 service nova] Releasing lock "refresh_cache-7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:45:29 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189914.695934, d034d519-491c-4963-95b1-48eaf2d81653 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:45:29 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: d034d519-491c-4963-95b1-48eaf2d81653] VM Stopped (Lifecycle Event)
Aug 16 12:45:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-4c568fdc-3c0f-429c-95b6-4829a889ec24 None None] [instance: d034d519-491c-4963-95b1-48eaf2d81653] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:45:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:31 user nova-compute[73520]: DEBUG nova.objects.instance [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'flavor' on Instance uuid 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:45:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:31 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:31 user nova-compute[73520]: INFO nova.compute.manager [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Attaching volume 174e3161-5d44-4caa-9b4c-587bc7b2e277 to /dev/vdb
Aug 16 12:45:32 user nova-compute[73520]: DEBUG os_brick.utils [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a64d6a-e2e8-4b38-b306-7b518462dfc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cfbdf2-3e59-4ad8-b446-a96776991047]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df118c0-8571-489c-9f21-e9571b3023ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab53cffb-cf0f-403c-afa9-1ffc89a53905]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:45:32 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:45:32 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4191606-4268-4ad6-a127-1fddffcceede]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG os_brick.utils [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:45:32 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Updating existing volume attachment record: 2513ced5-2ac4-4e81-9c04-e27139203c3a {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:45:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:36 user nova-compute[73520]: DEBUG nova.compute.manager [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:45:36 user nova-compute[73520]: INFO nova.compute.manager [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] instance snapshotting
Aug 16 12:45:36 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Beginning live snapshot process
Aug 16 12:45:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json -f qcow2 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json -f qcow2 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnj2fanmo/397dfff5c8a6434abb77e310deba8ad7.delta 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnj2fanmo/397dfff5c8a6434abb77e310deba8ad7.delta 1073741824" returned: 0 in 0.050s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:36 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 12:45:37 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:45:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73520) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 12:45:38 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 12:45:38 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:45:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnj2fanmo/397dfff5c8a6434abb77e310deba8ad7.delta /opt/stack/data/nova/instances/snapshots/tmpnj2fanmo/397dfff5c8a6434abb77e310deba8ad7 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnj2fanmo/397dfff5c8a6434abb77e310deba8ad7.delta /opt/stack/data/nova/instances/snapshots/tmpnj2fanmo/397dfff5c8a6434abb77e310deba8ad7" returned: 0 in 0.727s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:38 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Snapshot extracted, beginning image upload
Aug 16 12:45:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:45:41 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Snapshot image upload complete
Aug 16 12:45:41 user nova-compute[73520]: INFO nova.compute.manager [None req-0a1101fc-d345-43e1-bc43-5f388a2fb4fe tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Took 5.49 seconds to snapshot the instance on the hypervisor.
Aug 16 12:45:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEXrRbxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:45:42 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:45:42 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:45:42 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58ea6b3-d1a0-4b6d-9229-e67f55d600cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:45:42 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4827fb76-7017-45ca-b7cd-79fa788ce688]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277] added
Aug 16 12:45:42 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[25550a0b-a4d1-46e5-b915-390ba77c24a1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2733f9b-c584-483c-a583-55c57572e6ae]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEXrRbxF {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEXrRbxF" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a010fb45-4f7d-4cde-a6ce-975d0b0a7c70]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aEXrRbxF'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07d0159-8713-45c4-b865-abe04d2347d2]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c7fedb-ff02-44af-857e-e8868ff82770]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:45:42 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:45:42 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:45:42 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 12:45:42 user nova-compute[73520]: 
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52e6ada-5d74-4825-8447-2dbd65bda947]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277, portal: 172.16.0.220,3260]
Aug 16 12:45:42 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277, portal: 172.16.0.220,3260] successful.
Aug 16 12:45:42 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b758eec-61e8-4106-81ea-3bf7e12bbfe6]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eae97b9-58c9-4586-8d1e-4087f7894459]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 (non-flash)
Aug 16 12:45:42 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 (non-flash)
Aug 16 12:45:42 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64d5a1e-3641-4e79-978b-017d2e8bd58e]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:45:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEXrRbxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:45:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:45:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23139353461303764', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:45:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139353461303764', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:45:43 user nova-compute[73520]: DEBUG nova.objects.instance [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'flavor' on Instance uuid 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:45:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:45:43 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:45:43 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:45:43 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:45:43 user nova-compute[73520]:   <serial>174e3161-5d44-4caa-9b4c-587bc7b2e277</serial>
Aug 16 12:45:43 user nova-compute[73520]: </disk>
Aug 16 12:45:43 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:45:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "969317c7-66b5-4077-880b-abb157ef9bbb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "969317c7-66b5-4077-880b-abb157ef9bbb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:43 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:45:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:43 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:45:43 user nova-compute[73520]: INFO nova.compute.claims [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Claim successful on node user
Aug 16 12:45:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No VIF found with MAC fa:16:3e:9b:fd:e0, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1897acf9-913c-4f3c-a672-c855fb4fe4ff tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.376s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:45:44 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:45:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG nova.policy [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72663ad9bd9945b098337e0ebe4bef19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1282c7409c44eae81facffc98d5edc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:45:44 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Creating image(s)
Aug 16 12:45:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "/opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "/opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "/opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "33a0c88749e49587042deebf1bfae51af14cbf57" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "33a0c88749e49587042deebf1bfae51af14cbf57" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57.part --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57.part --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:45 user nova-compute[73520]: DEBUG nova.virt.images [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] 44687b46-9eb9-4fb2-9f65-c74873074bf0 was qcow2, converting to raw {{(pid=73520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 12:45:45 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:45:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57.part /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57.converted {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:45 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Successfully created port: f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57.part /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57.converted" returned: 0 in 0.645s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57.converted --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "33a0c88749e49587042deebf1bfae51af14cbf57" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.126s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Successfully updated port: f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "refresh_cache-969317c7-66b5-4077-880b-abb157ef9bbb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquired lock "refresh_cache-969317c7-66b5-4077-880b-abb157ef9bbb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57 --force-share --output=json" returned: 0 in 0.180s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "33a0c88749e49587042deebf1bfae51af14cbf57" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "33a0c88749e49587042deebf1bfae51af14cbf57" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-21f0a98b-3bfa-4e96-b7b8-e6ee09db8673 req-4530f2f1-15c1-4397-a145-c32662a12007 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received event network-changed-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-21f0a98b-3bfa-4e96-b7b8-e6ee09db8673 req-4530f2f1-15c1-4397-a145-c32662a12007 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Refreshing instance network info cache due to event network-changed-f210aa08-7e18-4f24-99f2-b82a5a8c735a. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-21f0a98b-3bfa-4e96-b7b8-e6ee09db8673 req-4530f2f1-15c1-4397-a145-c32662a12007 service nova] Acquiring lock "refresh_cache-969317c7-66b5-4077-880b-abb157ef9bbb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:45:46 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57 --force-share --output=json" returned: 0 in 0.180s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57,backing_fmt=raw /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57,backing_fmt=raw /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk 1073741824" returned: 0 in 0.049s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "33a0c88749e49587042deebf1bfae51af14cbf57" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.network.neutron [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Updating instance_info_cache with network_info: [{"id": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "address": "fa:16:3e:8d:83:db", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210aa08-7e", "ovs_interfaceid": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57 --force-share --output=json" returned: 0 in 0.168s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.objects.instance [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lazy-loading 'migration_context' on Instance uuid 969317c7-66b5-4077-880b-abb157ef9bbb {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Releasing lock "refresh_cache-969317c7-66b5-4077-880b-abb157ef9bbb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Instance network_info: |[{"id": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "address": "fa:16:3e:8d:83:db", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210aa08-7e", "ovs_interfaceid": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-21f0a98b-3bfa-4e96-b7b8-e6ee09db8673 req-4530f2f1-15c1-4397-a145-c32662a12007 service nova] Acquired lock "refresh_cache-969317c7-66b5-4077-880b-abb157ef9bbb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.network.neutron [req-21f0a98b-3bfa-4e96-b7b8-e6ee09db8673 req-4530f2f1-15c1-4397-a145-c32662a12007 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Refreshing network info cache for port f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Ensure instance console log exists: /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Start _get_guest_xml network_info=[{"id": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "address": "fa:16:3e:8d:83:db", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210aa08-7e", "ovs_interfaceid": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1bbf5ca5f2dc0ab3cb9c3a2608155588',container_format='bare',created_at=2023-08-16T12:45:36Z,direct_url=<?>,disk_format='qcow2',id=44687b46-9eb9-4fb2-9f65-c74873074bf0,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1104808890',owner='c1282c7409c44eae81facffc98d5edc7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T12:45:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': '44687b46-9eb9-4fb2-9f65-c74873074bf0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:45:47 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:45:47 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1bbf5ca5f2dc0ab3cb9c3a2608155588',container_format='bare',created_at=2023-08-16T12:45:36Z,direct_url=<?>,disk_format='qcow2',id=44687b46-9eb9-4fb2-9f65-c74873074bf0,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1104808890',owner='c1282c7409c44eae81facffc98d5edc7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T12:45:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1668113652',display_name='tempest-TestStampPattern-server-1668113652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1668113652',id=50,image_ref='44687b46-9eb9-4fb2-9f65-c74873074bf0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwRMExwQxQHRu0VQoTRBe9PUDpaEXm/5+Y0L1d60IAAQB1PQGosro0QC3rWNctmtdmkB0qFbKn1mN5TkKQK3A37SWFY5Z4Uqe3buZVFP2WzkA3jc3jRmdmYRx8pXMqNWw==',key_name='tempest-TestStampPattern-1822850313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1282c7409c44eae81facffc98d5edc7',ramdisk_id='',reservation_id='r-3m5v58ct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='38a325f8-e3cc-4033-92dd-dd47b6b4190c',image_min_disk='1',image_min_ram='0',image_owner_id='c1282c7409c44eae81facffc98d5edc7',image_owner_project_name='tempest-TestStampPattern-160903608',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-160903608-project-member',image_user_id='72663ad9bd9945b098337e0ebe4bef19',network_allocated='True',owner_project_name='tempest-TestStampPattern-160903608',owner_user_name='tempest-TestStampPattern-160903608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:45:44Z,user_data=None,user_id='72663ad9bd9945b098337e0ebe4bef19',uuid=969317c7-66b5-4077-880b-abb157ef9bbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "address": "fa:16:3e:8d:83:db", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210aa08-7e", "ovs_interfaceid": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Converting VIF {"id": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "address": "fa:16:3e:8d:83:db", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210aa08-7e", "ovs_interfaceid": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:83:db,bridge_name='br-int',has_traffic_filtering=True,id=f210aa08-7e18-4f24-99f2-b82a5a8c735a,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210aa08-7e') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.objects.instance [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lazy-loading 'pci_devices' on Instance uuid 969317c7-66b5-4077-880b-abb157ef9bbb {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:45:47 user nova-compute[73520]:   <uuid>969317c7-66b5-4077-880b-abb157ef9bbb</uuid>
Aug 16 12:45:47 user nova-compute[73520]:   <name>instance-00000032</name>
Aug 16 12:45:47 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:45:47 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:45:47 user nova-compute[73520]:   <metadata>
Aug 16 12:45:47 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:45:47 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:45:47 user nova-compute[73520]:       <nova:name>tempest-TestStampPattern-server-1668113652</nova:name>
Aug 16 12:45:47 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:45:47</nova:creationTime>
Aug 16 12:45:47 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:45:47 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:45:47 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:45:47 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:45:47 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:45:47 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:45:47 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:45:47 user nova-compute[73520]:       <nova:owner>
Aug 16 12:45:47 user nova-compute[73520]:         <nova:user uuid="72663ad9bd9945b098337e0ebe4bef19">tempest-TestStampPattern-160903608-project-member</nova:user>
Aug 16 12:45:47 user nova-compute[73520]:         <nova:project uuid="c1282c7409c44eae81facffc98d5edc7">tempest-TestStampPattern-160903608</nova:project>
Aug 16 12:45:47 user nova-compute[73520]:       </nova:owner>
Aug 16 12:45:47 user nova-compute[73520]:       <nova:root type="image" uuid="44687b46-9eb9-4fb2-9f65-c74873074bf0"/>
Aug 16 12:45:47 user nova-compute[73520]:       <nova:ports>
Aug 16 12:45:47 user nova-compute[73520]:         <nova:port uuid="f210aa08-7e18-4f24-99f2-b82a5a8c735a">
Aug 16 12:45:47 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 12:45:47 user nova-compute[73520]:         </nova:port>
Aug 16 12:45:47 user nova-compute[73520]:       </nova:ports>
Aug 16 12:45:47 user nova-compute[73520]:     </nova:instance>
Aug 16 12:45:47 user nova-compute[73520]:   </metadata>
Aug 16 12:45:47 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:45:47 user nova-compute[73520]:     <system>
Aug 16 12:45:47 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:45:47 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:45:47 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:45:47 user nova-compute[73520]:       <entry name="serial">969317c7-66b5-4077-880b-abb157ef9bbb</entry>
Aug 16 12:45:47 user nova-compute[73520]:       <entry name="uuid">969317c7-66b5-4077-880b-abb157ef9bbb</entry>
Aug 16 12:45:47 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:45:47 user nova-compute[73520]:     </system>
Aug 16 12:45:47 user nova-compute[73520]:   </sysinfo>
Aug 16 12:45:47 user nova-compute[73520]:   <os>
Aug 16 12:45:47 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:45:47 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:45:47 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:45:47 user nova-compute[73520]:   </os>
Aug 16 12:45:47 user nova-compute[73520]:   <features>
Aug 16 12:45:47 user nova-compute[73520]:     <acpi/>
Aug 16 12:45:47 user nova-compute[73520]:     <apic/>
Aug 16 12:45:47 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:45:47 user nova-compute[73520]:   </features>
Aug 16 12:45:47 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:45:47 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:45:47 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:45:47 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:45:47 user nova-compute[73520]:   </clock>
Aug 16 12:45:47 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:45:47 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:45:47 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:45:47 user nova-compute[73520]:   </cpu>
Aug 16 12:45:47 user nova-compute[73520]:   <devices>
Aug 16 12:45:47 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:45:47 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:45:47 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk"/>
Aug 16 12:45:47 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:45:47 user nova-compute[73520]:     </disk>
Aug 16 12:45:47 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:45:47 user nova-compute[73520]:       <mac address="fa:16:3e:8d:83:db"/>
Aug 16 12:45:47 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:45:47 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:45:47 user nova-compute[73520]:       <target dev="tapf210aa08-7e"/>
Aug 16 12:45:47 user nova-compute[73520]:     </interface>
Aug 16 12:45:47 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:45:47 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/console.log" append="off"/>
Aug 16 12:45:47 user nova-compute[73520]:     </serial>
Aug 16 12:45:47 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:45:47 user nova-compute[73520]:     <video>
Aug 16 12:45:47 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:45:47 user nova-compute[73520]:     </video>
Aug 16 12:45:47 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:45:47 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:45:47 user nova-compute[73520]:     </rng>
Aug 16 12:45:47 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:45:47 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:45:47 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:45:47 user nova-compute[73520]:     </memballoon>
Aug 16 12:45:47 user nova-compute[73520]:   </devices>
Aug 16 12:45:47 user nova-compute[73520]: </domain>
Aug 16 12:45:47 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1668113652',display_name='tempest-TestStampPattern-server-1668113652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1668113652',id=50,image_ref='44687b46-9eb9-4fb2-9f65-c74873074bf0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwRMExwQxQHRu0VQoTRBe9PUDpaEXm/5+Y0L1d60IAAQB1PQGosro0QC3rWNctmtdmkB0qFbKn1mN5TkKQK3A37SWFY5Z4Uqe3buZVFP2WzkA3jc3jRmdmYRx8pXMqNWw==',key_name='tempest-TestStampPattern-1822850313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1282c7409c44eae81facffc98d5edc7',ramdisk_id='',reservation_id='r-3m5v58ct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='38a325f8-e3cc-4033-92dd-dd47b6b4190c',image_min_disk='1',image_min_ram='0',image_owner_id='c1282c7409c44eae81facffc98d5edc7',image_owner_project_name='tempest-TestStampPattern-160903608',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-160903608-project-member',image_user_id='72663ad9bd9945b098337e0ebe4bef19',network_allocated='True',owner_project_name='tempest-TestStampPattern-160903608',owner_user_name='tempest-TestStampPattern-160903608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:45:44Z,user_data=None,user_id='72663ad9bd9945b098337e0ebe4bef19',uuid=969317c7-66b5-4077-880b-abb157ef9bbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "address": "fa:16:3e:8d:83:db", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210aa08-7e", "ovs_interfaceid": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Converting VIF {"id": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "address": "fa:16:3e:8d:83:db", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210aa08-7e", "ovs_interfaceid": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:83:db,bridge_name='br-int',has_traffic_filtering=True,id=f210aa08-7e18-4f24-99f2-b82a5a8c735a,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210aa08-7e') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG os_vif [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:83:db,bridge_name='br-int',has_traffic_filtering=True,id=f210aa08-7e18-4f24-99f2-b82a5a8c735a,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210aa08-7e') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf210aa08-7e, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf210aa08-7e, col_values=(('external_ids', {'iface-id': 'f210aa08-7e18-4f24-99f2-b82a5a8c735a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:83:db', 'vm-uuid': '969317c7-66b5-4077-880b-abb157ef9bbb'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:47 user nova-compute[73520]: INFO os_vif [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:83:db,bridge_name='br-int',has_traffic_filtering=True,id=f210aa08-7e18-4f24-99f2-b82a5a8c735a,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210aa08-7e')
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] No VIF found with MAC fa:16:3e:8d:83:db, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.network.neutron [req-21f0a98b-3bfa-4e96-b7b8-e6ee09db8673 req-4530f2f1-15c1-4397-a145-c32662a12007 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Updated VIF entry in instance network info cache for port f210aa08-7e18-4f24-99f2-b82a5a8c735a. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG nova.network.neutron [req-21f0a98b-3bfa-4e96-b7b8-e6ee09db8673 req-4530f2f1-15c1-4397-a145-c32662a12007 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Updating instance_info_cache with network_info: [{"id": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "address": "fa:16:3e:8d:83:db", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210aa08-7e", "ovs_interfaceid": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:45:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-21f0a98b-3bfa-4e96-b7b8-e6ee09db8673 req-4530f2f1-15c1-4397-a145-c32662a12007 service nova] Releasing lock "refresh_cache-969317c7-66b5-4077-880b-abb157ef9bbb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:45:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:49 user nova-compute[73520]: DEBUG nova.compute.manager [req-8f865aba-532d-4866-a1d5-b3c1f33394b6 req-3f5f8c4a-f8a5-48ed-ba1b-17c3ce4f896a service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received event network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:45:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8f865aba-532d-4866-a1d5-b3c1f33394b6 req-3f5f8c4a-f8a5-48ed-ba1b-17c3ce4f896a service nova] Acquiring lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8f865aba-532d-4866-a1d5-b3c1f33394b6 req-3f5f8c4a-f8a5-48ed-ba1b-17c3ce4f896a service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8f865aba-532d-4866-a1d5-b3c1f33394b6 req-3f5f8c4a-f8a5-48ed-ba1b-17c3ce4f896a service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:49 user nova-compute[73520]: DEBUG nova.compute.manager [req-8f865aba-532d-4866-a1d5-b3c1f33394b6 req-3f5f8c4a-f8a5-48ed-ba1b-17c3ce4f896a service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] No waiting events found dispatching network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:45:49 user nova-compute[73520]: WARNING nova.compute.manager [req-8f865aba-532d-4866-a1d5-b3c1f33394b6 req-3f5f8c4a-f8a5-48ed-ba1b-17c3ce4f896a service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received unexpected event network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a for instance with vm_state building and task_state spawning.
Aug 16 12:45:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:49 user nova-compute[73520]: DEBUG nova.objects.instance [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'flavor' on Instance uuid 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:45:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:50 user nova-compute[73520]: INFO nova.compute.manager [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Attaching volume 00a6f2e9-a031-4e8a-ba72-b20ab484fa19 to /dev/vdc
Aug 16 12:45:50 user nova-compute[73520]: DEBUG os_brick.utils [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[26982b59-6009-4d0c-b60e-8374d0e87f4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c58c58-d40d-41b0-a8a8-97bf0c5609b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7950bc2-8dae-4626-9872-6269fb729628]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[db02a945-4175-48e3-8b24-89c5b79ed442]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:45:50 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c773f4c3-f3e3-4023-a8b5-c2baf4fd6185]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG os_brick.utils [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Updating existing volume attachment record: 1e57b63b-e213-419e-a0a1-7800dfdf4cdb {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189950.894409, 969317c7-66b5-4077-880b-abb157ef9bbb => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:45:50 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] VM Resumed (Lifecycle Event)
Aug 16 12:45:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:45:50 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Instance spawned successfully.
Aug 16 12:45:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:45:50 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:45:50 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692189950.8948336, 969317c7-66b5-4077-880b-abb157ef9bbb => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:45:50 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] VM Started (Lifecycle Event)
Aug 16 12:45:50 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:45:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:45:50 user nova-compute[73520]: INFO nova.compute.manager [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 16 12:45:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:45:51 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:45:51 user nova-compute[73520]: INFO nova.compute.manager [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Took 7.16 seconds to build instance.
Aug 16 12:45:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-8568e3ab-6886-453f-97b7-a29e47e18f01 req-032a3612-2da3-41a1-9f10-7ec7423323c5 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received event network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:45:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8568e3ab-6886-453f-97b7-a29e47e18f01 req-032a3612-2da3-41a1-9f10-7ec7423323c5 service nova] Acquiring lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:45:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8568e3ab-6886-453f-97b7-a29e47e18f01 req-032a3612-2da3-41a1-9f10-7ec7423323c5 service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:45:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8568e3ab-6886-453f-97b7-a29e47e18f01 req-032a3612-2da3-41a1-9f10-7ec7423323c5 service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:51 user nova-compute[73520]: DEBUG nova.compute.manager [req-8568e3ab-6886-453f-97b7-a29e47e18f01 req-032a3612-2da3-41a1-9f10-7ec7423323c5 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] No waiting events found dispatching network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:45:51 user nova-compute[73520]: WARNING nova.compute.manager [req-8568e3ab-6886-453f-97b7-a29e47e18f01 req-032a3612-2da3-41a1-9f10-7ec7423323c5 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received unexpected event network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a for instance with vm_state active and task_state None.
Aug 16 12:45:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a082bcb9-787d-4443-ad62-941870c49d92 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "969317c7-66b5-4077-880b-abb157ef9bbb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.274s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:45:52 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:53 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:45:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:45:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:45:54 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:45:57 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:45:57 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:45:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:45:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AGNUqzTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:46:00 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:46:00 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:46:00 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8219ad7a-7336-4e15-bf9c-1d67904b27b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:46:00 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a532d599-e9e1-4bf3-9ddd-1c4a6600e477]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19] added
Aug 16 12:46:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[191e73e9-185d-4938-b521-e5122e92e7cf]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f8b470-341a-4114-9d72-a02452b542af]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AGNUqzTW {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AGNUqzTW" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4306ba3e-6908-418c-8c1d-f3aadfd80eef]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AGNUqzTW'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f24f8d-a7ee-4027-bfd4-bee1a68a6acb]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[724fea68-05e4-4a22-ae4d-f5330ecbf032]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 (non-flash)
Aug 16 12:46:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 (non-flash)
Aug 16 12:46:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de82d3b-a9b2-4d4c-ace7-84aec14f8562]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19, portal: 172.16.0.220,3260]
Aug 16 12:46:00 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19, portal: 172.16.0.220,3260] successful.
Aug 16 12:46:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6312f29-edbc-4a99-9e84-9ccc97d8daff]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d3b462-5b16-4d06-9ffc-5700407a21ef]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 (non-flash)
Aug 16 12:46:00 user nova-compute[73520]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 (non-flash)
Aug 16 12:46:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 (non-flash)
Aug 16 12:46:00 user nova-compute[73520]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 (non-flash)
Aug 16 12:46:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9624f5ee-4ab6-4329-a3d9-86a9db359b7f]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:46:01 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:46:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AGNUqzTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:46:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:46:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23830316136363164', 'path': '/dev/sdc'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:46:01 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830316136363164', 'path': '/dev/sdc'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:46:01 user nova-compute[73520]: DEBUG nova.objects.instance [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'flavor' on Instance uuid 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:46:01 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:46:01 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:46:01 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:46:01 user nova-compute[73520]:   <target dev="vdc" bus="virtio"/>
Aug 16 12:46:01 user nova-compute[73520]:   <serial>00a6f2e9-a031-4e8a-ba72-b20ab484fa19</serial>
Aug 16 12:46:01 user nova-compute[73520]: </disk>
Aug 16 12:46:01 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:46:01 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:46:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:46:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:46:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:01 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] No VIF found with MAC fa:16:3e:9b:fd:e0, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8faaeaab-1280-4793-8e33-46f923616f7d tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.281s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:46:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:03 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:46:03 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:46:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8426MB free_disk=25.143726348876953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:46:03 user nova-compute[73520]: INFO nova.compute.manager [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Detaching volume 174e3161-5d44-4caa-9b4c-587bc7b2e277
Aug 16 12:46:03 user nova-compute[73520]: INFO nova.virt.block_device [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Attempting to driver detach volume 174e3161-5d44-4caa-9b4c-587bc7b2e277 from mountpoint /dev/vdb
Aug 16 12:46:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 969317c7-66b5-4077-880b-abb157ef9bbb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Attempting to detach device vdb from instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:46:03 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:46:03 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:46:03 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:46:03 user nova-compute[73520]:   <serial>174e3161-5d44-4caa-9b4c-587bc7b2e277</serial>
Aug 16 12:46:03 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:46:03 user nova-compute[73520]: </disk>
Aug 16 12:46:03 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:46:03 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully detached device vdb from instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 from the persistent domain config.
Aug 16 12:46:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:46:03 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:46:03 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:46:03 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:46:03 user nova-compute[73520]:   <serial>174e3161-5d44-4caa-9b4c-587bc7b2e277</serial>
Aug 16 12:46:03 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:46:03 user nova-compute[73520]: </disk>
Aug 16 12:46:03 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:46:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692189964.2256823, 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:46:04 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully detached device vdb from instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 from the live domain config.
Aug 16 12:46:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEXrRbxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:46:04 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1576a7e-fabd-4a97-bced-23e0035eb5c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[daef58b1-8d85-4ea0-84e9-886a6239003b]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 (non-flash)
Aug 16 12:46:04 user nova-compute[73520]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 (non-flash)
Aug 16 12:46:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 (non-flash)
Aug 16 12:46:04 user nova-compute[73520]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 (non-flash)
Aug 16 12:46:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c4be5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1c9f2a-e292-4248-b32e-a35c212a48e3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[301c5956-f7d6-4b44-86b1-619efa3a7acc]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d61e18a-c03b-4ebd-bdea-8bf40b97ac27]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0487ec6d-d067-4cc3-ac39-868e7cfe46bd]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[31613b03-1306-47d9-be64-a0c42de7f3e0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[412f2aba-3fb5-4e7b-ba70-004334ba60a7]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277, portal: 172.16.0.220,3260]
Aug 16 12:46:04 user nova-compute[73520]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277, portal: 172.16.0.220,3260] successful.
Aug 16 12:46:04 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:174e3161-5d44-4caa-9b4c-587bc7b2e277 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[803667eb-218b-4dfc-9fb4-1d42d85d6c9d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] <== disconnect_volume: return (274ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:46:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:05 user nova-compute[73520]: DEBUG nova.objects.instance [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'flavor' on Instance uuid 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:46:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-60e0b922-c000-48ff-83bd-c4cf1096609e tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.642s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:46:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:46:05 user nova-compute[73520]: INFO nova.compute.manager [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Detaching volume 00a6f2e9-a031-4e8a-ba72-b20ab484fa19
Aug 16 12:46:05 user nova-compute[73520]: INFO nova.virt.block_device [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Attempting to driver detach volume 00a6f2e9-a031-4e8a-ba72-b20ab484fa19 from mountpoint /dev/vdc
Aug 16 12:46:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Attempting to detach device vdc from instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:46:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:46:05 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:46:05 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:46:05 user nova-compute[73520]:   <target dev="vdc" bus="virtio"/>
Aug 16 12:46:05 user nova-compute[73520]:   <serial>00a6f2e9-a031-4e8a-ba72-b20ab484fa19</serial>
Aug 16 12:46:05 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 12:46:05 user nova-compute[73520]: </disk>
Aug 16 12:46:05 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:46:06 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully detached device vdc from instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 from the persistent domain config.
Aug 16 12:46:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:46:06 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:46:06 user nova-compute[73520]:   <source dev="/dev/sdc"/>
Aug 16 12:46:06 user nova-compute[73520]:   <target dev="vdc" bus="virtio"/>
Aug 16 12:46:06 user nova-compute[73520]:   <serial>00a6f2e9-a031-4e8a-ba72-b20ab484fa19</serial>
Aug 16 12:46:06 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 12:46:06 user nova-compute[73520]: </disk>
Aug 16 12:46:06 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692189966.4310105, 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:46:06 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully detached device vdc from instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 from the live domain config.
Aug 16 12:46:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AGNUqzTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:46:06 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6a2ec8-e037-4485-84d4-8058daf077d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b391ff-3b5e-46b3-92de-158479dd3a0e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 (non-flash)
Aug 16 12:46:06 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 (non-flash)
Aug 16 12:46:06 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c4bc430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19'): ({'sdc'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Removing single pathed devices sdc {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9963bc07-8ab9-417e-b2b6-3cc563e19940]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8a550d-3bb3-4f66-8e24-859768e35644]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Flushing IO for device /dev/sdc {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c135dcb2-4aa2-439d-b998-56edc72508d8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b3dd1a-1904-4c1a-a701-0e30ce600387]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] SCSI volumes sdc have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[950ba4bf-d7f5-4882-804f-74d8d8e720c0]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58678d0-9e0b-495b-bbd7-5d24a87d0c87]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19, portal: 172.16.0.220,3260]
Aug 16 12:46:06 user nova-compute[73520]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19, portal: 172.16.0.220,3260] successful.
Aug 16 12:46:06 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a6f2e9-a031-4e8a-ba72-b20ab484fa19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15c66bf-a37f-46d5-9216-b4897d05761e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] <== disconnect_volume: return (291ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:46:06 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:46:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:07 user nova-compute[73520]: DEBUG nova.objects.instance [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'flavor' on Instance uuid 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:46:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-58b98e2f-fc0c-4bee-984b-f600553d2f04 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.758s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:08 user nova-compute[73520]: INFO nova.compute.manager [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Terminating instance
Aug 16 12:46:08 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-d93cf15d-2b90-4231-921f-fc85ac68162e req-6200ba48-8850-47d6-ad20-71ef2616618c service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received event network-vif-unplugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d93cf15d-2b90-4231-921f-fc85ac68162e req-6200ba48-8850-47d6-ad20-71ef2616618c service nova] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d93cf15d-2b90-4231-921f-fc85ac68162e req-6200ba48-8850-47d6-ad20-71ef2616618c service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d93cf15d-2b90-4231-921f-fc85ac68162e req-6200ba48-8850-47d6-ad20-71ef2616618c service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-d93cf15d-2b90-4231-921f-fc85ac68162e req-6200ba48-8850-47d6-ad20-71ef2616618c service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] No waiting events found dispatching network-vif-unplugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG nova.compute.manager [req-d93cf15d-2b90-4231-921f-fc85ac68162e req-6200ba48-8850-47d6-ad20-71ef2616618c service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received event network-vif-unplugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:46:08 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:09 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Instance destroyed successfully.
Aug 16 12:46:09 user nova-compute[73520]: DEBUG nova.objects.instance [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lazy-loading 'resources' on Instance uuid 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1288359729',display_name='tempest-AttachVolumeTestJSON-server-1288359729',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1288359729',id=49,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEQbCTLuT1N+j1n44RpE5DoJpA71qMJUxatBnzH0Kbai2kC/L1yUPxBH+YuE5RTJbQB5Wm7BsRkfYFkHw/+UHMhsKMBsK2oGzEce5IpHCT3rMcUYFTnAWTLAcFq18TBBg==',key_name='tempest-keypair-1327296775',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:43:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='446e9796da1f4303bb7d628fa8c8c3c3',ramdisk_id='',reservation_id='r-g151ecw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1174912644',owner_user_name='tempest-AttachVolumeTestJSON-1174912644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:43:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9ef4b48f36408eba035f0d7e277dcb',uuid=7a2f41a1-de0d-49df-a9a0-b518bf3c0f70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "address": "fa:16:3e:9b:fd:e0", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5159786e-66", "ovs_interfaceid": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converting VIF {"id": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "address": "fa:16:3e:9b:fd:e0", "network": {"id": "9172187a-219e-4128-8391-d913f0f28b82", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1086304703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446e9796da1f4303bb7d628fa8c8c3c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5159786e-66", "ovs_interfaceid": "5159786e-66a6-4cd9-86e8-40fb3c16f802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:fd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5159786e-66a6-4cd9-86e8-40fb3c16f802,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5159786e-66') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG os_vif [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:fd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5159786e-66a6-4cd9-86e8-40fb3c16f802,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5159786e-66') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5159786e-66, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:46:09 user nova-compute[73520]: INFO os_vif [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:fd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5159786e-66a6-4cd9-86e8-40fb3c16f802,network=Network(9172187a-219e-4128-8391-d913f0f28b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5159786e-66')
Aug 16 12:46:09 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Deleting instance files /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70_del
Aug 16 12:46:09 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Deletion of /opt/stack/data/nova/instances/7a2f41a1-de0d-49df-a9a0-b518bf3c0f70_del complete
Aug 16 12:46:09 user nova-compute[73520]: INFO nova.compute.manager [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 16 12:46:09 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updating instance_info_cache with network_info: [{"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:46:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received event network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] No waiting events found dispatching network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:46:10 user nova-compute[73520]: WARNING nova.compute.manager [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received unexpected event network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 for instance with vm_state active and task_state deleting.
Aug 16 12:46:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received event network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] No waiting events found dispatching network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:46:10 user nova-compute[73520]: WARNING nova.compute.manager [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received unexpected event network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 for instance with vm_state active and task_state deleting.
Aug 16 12:46:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received event network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] No waiting events found dispatching network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:46:10 user nova-compute[73520]: WARNING nova.compute.manager [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received unexpected event network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 for instance with vm_state active and task_state deleting.
Aug 16 12:46:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received event network-vif-unplugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] No waiting events found dispatching network-vif-unplugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:46:10 user nova-compute[73520]: DEBUG nova.compute.manager [req-6075baf5-55e4-493c-b50b-90f0936cc6a6 req-e17d57a2-3291-423f-b519-af83fdfd7cbc service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received event network-vif-unplugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:46:11 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:46:11 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Took 1.58 seconds to deallocate network for instance.
Aug 16 12:46:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:46:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:46:11 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:46:11 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:46:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:11 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Deleted allocations for instance 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70
Aug 16 12:46:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a72fd665-d953-4e6e-a85c-1ecd0bb2ba10 tempest-AttachVolumeTestJSON-1174912644 tempest-AttachVolumeTestJSON-1174912644-project-member] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.991s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-71ce5f1e-c681-4df4-9a02-3749574dd6f8 req-1ac66b8d-dad8-4bce-a2a3-9e5b8ed003be service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received event network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:46:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-71ce5f1e-c681-4df4-9a02-3749574dd6f8 req-1ac66b8d-dad8-4bce-a2a3-9e5b8ed003be service nova] Acquiring lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:46:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-71ce5f1e-c681-4df4-9a02-3749574dd6f8 req-1ac66b8d-dad8-4bce-a2a3-9e5b8ed003be service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:46:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-71ce5f1e-c681-4df4-9a02-3749574dd6f8 req-1ac66b8d-dad8-4bce-a2a3-9e5b8ed003be service nova] Lock "7a2f41a1-de0d-49df-a9a0-b518bf3c0f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:46:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-71ce5f1e-c681-4df4-9a02-3749574dd6f8 req-1ac66b8d-dad8-4bce-a2a3-9e5b8ed003be service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] No waiting events found dispatching network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:46:13 user nova-compute[73520]: WARNING nova.compute.manager [req-71ce5f1e-c681-4df4-9a02-3749574dd6f8 req-1ac66b8d-dad8-4bce-a2a3-9e5b8ed003be service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received unexpected event network-vif-plugged-5159786e-66a6-4cd9-86e8-40fb3c16f802 for instance with vm_state deleted and task_state None.
Aug 16 12:46:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-71ce5f1e-c681-4df4-9a02-3749574dd6f8 req-1ac66b8d-dad8-4bce-a2a3-9e5b8ed003be service nova] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Received event network-vif-deleted-5159786e-66a6-4cd9-86e8-40fb3c16f802 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:46:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:24 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692189969.3732696, 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:46:24 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] VM Stopped (Lifecycle Event)
Aug 16 12:46:24 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2e4358e6-c719-4b13-99d4-3be97721f05a None None] [instance: 7a2f41a1-de0d-49df-a9a0-b518bf3c0f70] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:46:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:46:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:46:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:46:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:46:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:46:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:46:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:46:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:46:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:46:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:46:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:46:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:46:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:46:51 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:46:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:46:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:46:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:46:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:46:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:55 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:46:55 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:46:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:46:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:46:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:46:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:46:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:46:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:46:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:46:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:46:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:46:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:01 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:47:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:47:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:47:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:47:01 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:47:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:03 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:47:03 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:47:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8685MB free_disk=25.168315887451172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:47:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:47:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:47:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:47:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 969317c7-66b5-4077-880b-abb157ef9bbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:47:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:47:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:47:03 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:47:03 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:47:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:47:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:47:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:47:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:47:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:47:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:47:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:09 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:47:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:47:09 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 12:47:13 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:47:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:47:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:47:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:47:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:47:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:47:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:47:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-8e003245-9ae2-4354-8f5c-456c9b8e42b4 req-f7f1bd36-a2d1-47fd-87e3-11bc9d58fa1a service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received event network-changed-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:47:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-8e003245-9ae2-4354-8f5c-456c9b8e42b4 req-f7f1bd36-a2d1-47fd-87e3-11bc9d58fa1a service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Refreshing instance network info cache due to event network-changed-f210aa08-7e18-4f24-99f2-b82a5a8c735a. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:47:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8e003245-9ae2-4354-8f5c-456c9b8e42b4 req-f7f1bd36-a2d1-47fd-87e3-11bc9d58fa1a service nova] Acquiring lock "refresh_cache-969317c7-66b5-4077-880b-abb157ef9bbb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:47:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8e003245-9ae2-4354-8f5c-456c9b8e42b4 req-f7f1bd36-a2d1-47fd-87e3-11bc9d58fa1a service nova] Acquired lock "refresh_cache-969317c7-66b5-4077-880b-abb157ef9bbb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:47:36 user nova-compute[73520]: DEBUG nova.network.neutron [req-8e003245-9ae2-4354-8f5c-456c9b8e42b4 req-f7f1bd36-a2d1-47fd-87e3-11bc9d58fa1a service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Refreshing network info cache for port f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "969317c7-66b5-4077-880b-abb157ef9bbb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "969317c7-66b5-4077-880b-abb157ef9bbb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG nova.objects.instance [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lazy-loading 'flavor' on Instance uuid 969317c7-66b5-4077-880b-abb157ef9bbb {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "969317c7-66b5-4077-880b-abb157ef9bbb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG nova.network.neutron [req-8e003245-9ae2-4354-8f5c-456c9b8e42b4 req-f7f1bd36-a2d1-47fd-87e3-11bc9d58fa1a service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Updated VIF entry in instance network info cache for port f210aa08-7e18-4f24-99f2-b82a5a8c735a. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG nova.network.neutron [req-8e003245-9ae2-4354-8f5c-456c9b8e42b4 req-f7f1bd36-a2d1-47fd-87e3-11bc9d58fa1a service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Updating instance_info_cache with network_info: [{"id": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "address": "fa:16:3e:8d:83:db", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210aa08-7e", "ovs_interfaceid": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-8e003245-9ae2-4354-8f5c-456c9b8e42b4 req-f7f1bd36-a2d1-47fd-87e3-11bc9d58fa1a service nova] Releasing lock "refresh_cache-969317c7-66b5-4077-880b-abb157ef9bbb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "969317c7-66b5-4077-880b-abb157ef9bbb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "969317c7-66b5-4077-880b-abb157ef9bbb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:47:37 user nova-compute[73520]: INFO nova.compute.manager [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Attaching volume 437b43c5-5452-4725-8edb-f5d4cc07501f to /dev/vdb
Aug 16 12:47:37 user nova-compute[73520]: DEBUG os_brick.utils [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6347f162-616d-4166-aaf8-0084804a87cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20adaca-3f0d-4fc7-ad5f-ed6bfb13e72d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4559decc-6fc3-4937-a3bf-726c3849cf27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e6d58f-05ae-47cc-9df9-e6a016a8c664]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:47:37 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:47:37 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a116984-b175-4f98-9baa-568993290e45]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG os_brick.utils [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:47:37 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Updating existing volume attachment record: 2b7b43c1-ba3b-46a6-b267-005c2b27d669 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:47:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:47:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIcWzBdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:47:47 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:47:47 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:47:47 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c410b58-1214-444e-a989-e567b8467271]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:47:47 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae76ba2d-9aab-4cdb-839b-4d5f71aa5d23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f] added
Aug 16 12:47:47 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[94192aad-156e-49b0-b567-913196cefde9]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c68f0b3-bd32-4020-ab5c-ef638de3cf88]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pIcWzBdJ {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pIcWzBdJ" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfb8791-e5f7-4f80-a9ed-0c37971b2b2e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pIcWzBdJ'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[079f7314-2e60-4be2-a686-2c2f8134a251]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f44931-5a77-4f31-9d29-478dd062ebc7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:47:47 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:47:47 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:47:47 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 12:47:47 user nova-compute[73520]: 
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3462b572-35ad-4f6d-89f6-a2c491707fe8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f, portal: 172.16.0.220,3260]
Aug 16 12:47:47 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f, portal: 172.16.0.220,3260] successful.
Aug 16 12:47:47 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e689b2e-c557-492e-8d09-883930445456]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ce5dcc-61ae-4805-a705-7d26572c07bc]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f (non-flash)
Aug 16 12:47:47 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f (non-flash)
Aug 16 12:47:47 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5855d544-ef96-49e6-b9ee-d6a6dc23c39d]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:47 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:47:48 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:47:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIcWzBdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:47:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:47:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23038323661313039', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:47:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038323661313039', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:47:48 user nova-compute[73520]: DEBUG nova.objects.instance [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lazy-loading 'flavor' on Instance uuid 969317c7-66b5-4077-880b-abb157ef9bbb {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:47:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:47:48 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:47:48 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:47:48 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:47:48 user nova-compute[73520]:   <serial>437b43c5-5452-4725-8edb-f5d4cc07501f</serial>
Aug 16 12:47:48 user nova-compute[73520]: </disk>
Aug 16 12:47:48 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:47:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:47:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:47:49 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] No VIF found with MAC fa:16:3e:8d:83:db, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:47:49 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-27c2ebf4-e7cc-4570-9c08-ec276df58216 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "969317c7-66b5-4077-880b-abb157ef9bbb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.777s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:47:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "969317c7-66b5-4077-880b-abb157ef9bbb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:47:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "969317c7-66b5-4077-880b-abb157ef9bbb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:47:51 user nova-compute[73520]: INFO nova.compute.manager [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Detaching volume 437b43c5-5452-4725-8edb-f5d4cc07501f
Aug 16 12:47:51 user nova-compute[73520]: INFO nova.virt.block_device [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Attempting to driver detach volume 437b43c5-5452-4725-8edb-f5d4cc07501f from mountpoint /dev/vdb
Aug 16 12:47:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Attempting to detach device vdb from instance 969317c7-66b5-4077-880b-abb157ef9bbb from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:47:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:47:51 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:47:51 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:47:51 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:47:51 user nova-compute[73520]:   <serial>437b43c5-5452-4725-8edb-f5d4cc07501f</serial>
Aug 16 12:47:51 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:47:51 user nova-compute[73520]: </disk>
Aug 16 12:47:51 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:47:51 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Successfully detached device vdb from instance 969317c7-66b5-4077-880b-abb157ef9bbb from the persistent domain config.
Aug 16 12:47:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 969317c7-66b5-4077-880b-abb157ef9bbb from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:47:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:47:51 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:47:51 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:47:51 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:47:51 user nova-compute[73520]:   <serial>437b43c5-5452-4725-8edb-f5d4cc07501f</serial>
Aug 16 12:47:51 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 12:47:51 user nova-compute[73520]: </disk>
Aug 16 12:47:51 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:47:51 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692190072.0860813, 969317c7-66b5-4077-880b-abb157ef9bbb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 969317c7-66b5-4077-880b-abb157ef9bbb {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:47:52 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Successfully detached device vdb from instance 969317c7-66b5-4077-880b-abb157ef9bbb from the live domain config.
Aug 16 12:47:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIcWzBdJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:47:52 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a2d530-427e-45dc-b3cf-0c7a8707a77c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc0373f-294c-42fd-b5ca-7b1643dda1ea]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f (non-flash)
Aug 16 12:47:52 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f (non-flash)
Aug 16 12:47:52 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c691b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0398e2-e76d-4bba-8f42-afbaeb730016]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cbb979-dc6f-4168-915e-3b8a88145654]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0162a801-6396-466f-8d08-0be1ad7b2034]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fbe4a4-dcf1-4a1b-9477-7751e75d793f]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8fb12f-76bc-4e14-8fef-1008921b3d90]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8942b7-5713-4df4-8271-7cc298818bf4]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f, portal: 172.16.0.220,3260]
Aug 16 12:47:52 user nova-compute[73520]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f, portal: 172.16.0.220,3260] successful.
Aug 16 12:47:52 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b43c5-5452-4725-8edb-f5d4cc07501f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82cfe0a-8766-42d1-bbba-a11f45e660dc]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] <== disconnect_volume: return (271ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:47:52 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:47:53 user nova-compute[73520]: DEBUG nova.objects.instance [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lazy-loading 'flavor' on Instance uuid 969317c7-66b5-4077-880b-abb157ef9bbb {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:47:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-54e36a87-9ea0-4f64-aff0-a4cd4de5192c tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "969317c7-66b5-4077-880b-abb157ef9bbb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.765s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:47:53 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:47:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:47:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:47:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:47:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:47:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:47:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:55 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:47:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:47:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:47:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:47:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:47:59 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:48:00 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:48:02 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:48:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:48:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:48:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:48:02 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:48:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:48:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:48:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:48:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:48:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:48:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:48:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:48:03 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:48:04 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:48:04 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:48:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8670MB free_disk=25.166126251220703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:48:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:48:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:48:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:48:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 969317c7-66b5-4077-880b-abb157ef9bbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:48:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:48:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:48:04 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:48:04 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:48:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:48:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:48:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:48:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:48:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:11 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:48:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:48:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:48:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:48:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:48:11 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:48:11 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 38a325f8-e3cc-4033-92dd-dd47b6b4190c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:48:12 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updating instance_info_cache with network_info: [{"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:48:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:48:12 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:48:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:48:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:48:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:48:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:48:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:48:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:48:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Verify base images {{(pid=73520) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Image id 44687b46-9eb9-4fb2-9f65-c74873074bf0 yields fingerprint 33a0c88749e49587042deebf1bfae51af14cbf57 {{(pid=73520) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 12:48:21 user nova-compute[73520]: INFO nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] image 44687b46-9eb9-4fb2-9f65-c74873074bf0 at (/opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57): checking
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] image 44687b46-9eb9-4fb2-9f65-c74873074bf0 at (/opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57): image is in use {{(pid=73520) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73520) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Image id ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe yields fingerprint dd55533720e0904ac515f90283b986b4a7612d61 {{(pid=73520) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 12:48:21 user nova-compute[73520]: INFO nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] image ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe at (/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61): checking
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] image ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe at (/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61): image is in use {{(pid=73520) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] 38a325f8-e3cc-4033-92dd-dd47b6b4190c is a valid instance name {{(pid=73520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] 38a325f8-e3cc-4033-92dd-dd47b6b4190c has a disk file {{(pid=73520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c is backed by dd55533720e0904ac515f90283b986b4a7612d61 {{(pid=73520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] 969317c7-66b5-4077-880b-abb157ef9bbb is a valid instance name {{(pid=73520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] 969317c7-66b5-4077-880b-abb157ef9bbb has a disk file {{(pid=73520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 969317c7-66b5-4077-880b-abb157ef9bbb is backed by 33a0c88749e49587042deebf1bfae51af14cbf57 {{(pid=73520) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 12:48:21 user nova-compute[73520]: WARNING nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c
Aug 16 12:48:21 user nova-compute[73520]: WARNING nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df
Aug 16 12:48:21 user nova-compute[73520]: WARNING nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Unknown base file: /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05
Aug 16 12:48:21 user nova-compute[73520]: WARNING nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1
Aug 16 12:48:21 user nova-compute[73520]: WARNING nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Unknown base file: /opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000
Aug 16 12:48:21 user nova-compute[73520]: WARNING nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f
Aug 16 12:48:21 user nova-compute[73520]: INFO nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Active base files: /opt/stack/data/nova/instances/_base/33a0c88749e49587042deebf1bfae51af14cbf57 /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61
Aug 16 12:48:21 user nova-compute[73520]: INFO nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Removable base files: /opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05 /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1 /opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000 /opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f
Aug 16 12:48:21 user nova-compute[73520]: INFO nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a4562045ae7837725180bf8cfa3177f4e007537c
Aug 16 12:48:21 user nova-compute[73520]: INFO nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c06b62fc25b4ea2158bd57cf19feae4a7fa1c2df
Aug 16 12:48:21 user nova-compute[73520]: INFO nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/27ec883c57fe7fcaabf62cd5d4c9aa2760c84e05
Aug 16 12:48:21 user nova-compute[73520]: INFO nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cb71fde6d83d95a62113ee4636eec78a120c85a1
Aug 16 12:48:21 user nova-compute[73520]: INFO nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/108ecb3f0d8273983aabdb39f0d0d15fd915e000
Aug 16 12:48:21 user nova-compute[73520]: INFO nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3018ab356cf735caad3c5a1bcb9733eb6470884f
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Verification complete {{(pid=73520) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Verify swap images {{(pid=73520) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 16 12:48:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.imagecache [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Verify ephemeral images {{(pid=73520) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 16 12:48:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:48:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:48:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:48:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:48:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-f3aa9e02-11a1-401e-8eda-ff314d04e8ff req-ca8fa654-f429-4773-95e6-3f86845d6ccd service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received event network-changed-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-f3aa9e02-11a1-401e-8eda-ff314d04e8ff req-ca8fa654-f429-4773-95e6-3f86845d6ccd service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Refreshing instance network info cache due to event network-changed-f210aa08-7e18-4f24-99f2-b82a5a8c735a. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f3aa9e02-11a1-401e-8eda-ff314d04e8ff req-ca8fa654-f429-4773-95e6-3f86845d6ccd service nova] Acquiring lock "refresh_cache-969317c7-66b5-4077-880b-abb157ef9bbb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f3aa9e02-11a1-401e-8eda-ff314d04e8ff req-ca8fa654-f429-4773-95e6-3f86845d6ccd service nova] Acquired lock "refresh_cache-969317c7-66b5-4077-880b-abb157ef9bbb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG nova.network.neutron [req-f3aa9e02-11a1-401e-8eda-ff314d04e8ff req-ca8fa654-f429-4773-95e6-3f86845d6ccd service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Refreshing network info cache for port f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "969317c7-66b5-4077-880b-abb157ef9bbb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "969317c7-66b5-4077-880b-abb157ef9bbb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:48:42 user nova-compute[73520]: INFO nova.compute.manager [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Terminating instance
Aug 16 12:48:42 user nova-compute[73520]: DEBUG nova.compute.manager [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-f0780a6c-2c18-478b-874f-f08bba9c8ffb req-30d2b4f2-c3e3-49f3-9407-58e1124ec809 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received event network-vif-unplugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f0780a6c-2c18-478b-874f-f08bba9c8ffb req-30d2b4f2-c3e3-49f3-9407-58e1124ec809 service nova] Acquiring lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f0780a6c-2c18-478b-874f-f08bba9c8ffb req-30d2b4f2-c3e3-49f3-9407-58e1124ec809 service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f0780a6c-2c18-478b-874f-f08bba9c8ffb req-30d2b4f2-c3e3-49f3-9407-58e1124ec809 service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-f0780a6c-2c18-478b-874f-f08bba9c8ffb req-30d2b4f2-c3e3-49f3-9407-58e1124ec809 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] No waiting events found dispatching network-vif-unplugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG nova.compute.manager [req-f0780a6c-2c18-478b-874f-f08bba9c8ffb req-30d2b4f2-c3e3-49f3-9407-58e1124ec809 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received event network-vif-unplugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:42 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG nova.network.neutron [req-f3aa9e02-11a1-401e-8eda-ff314d04e8ff req-ca8fa654-f429-4773-95e6-3f86845d6ccd service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Updated VIF entry in instance network info cache for port f210aa08-7e18-4f24-99f2-b82a5a8c735a. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG nova.network.neutron [req-f3aa9e02-11a1-401e-8eda-ff314d04e8ff req-ca8fa654-f429-4773-95e6-3f86845d6ccd service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Updating instance_info_cache with network_info: [{"id": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "address": "fa:16:3e:8d:83:db", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210aa08-7e", "ovs_interfaceid": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f3aa9e02-11a1-401e-8eda-ff314d04e8ff req-ca8fa654-f429-4773-95e6-3f86845d6ccd service nova] Releasing lock "refresh_cache-969317c7-66b5-4077-880b-abb157ef9bbb" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:43 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Instance destroyed successfully.
Aug 16 12:48:43 user nova-compute[73520]: DEBUG nova.objects.instance [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lazy-loading 'resources' on Instance uuid 969317c7-66b5-4077-880b-abb157ef9bbb {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1668113652',display_name='tempest-TestStampPattern-server-1668113652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1668113652',id=50,image_ref='44687b46-9eb9-4fb2-9f65-c74873074bf0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwRMExwQxQHRu0VQoTRBe9PUDpaEXm/5+Y0L1d60IAAQB1PQGosro0QC3rWNctmtdmkB0qFbKn1mN5TkKQK3A37SWFY5Z4Uqe3buZVFP2WzkA3jc3jRmdmYRx8pXMqNWw==',key_name='tempest-TestStampPattern-1822850313',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:45:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1282c7409c44eae81facffc98d5edc7',ramdisk_id='',reservation_id='r-3m5v58ct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='38a325f8-e3cc-4033-92dd-dd47b6b4190c',image_min_disk='1',image_min_ram='0',image_owner_id='c1282c7409c44eae81facffc98d5edc7',image_owner_project_name='tempest-TestStampPattern-160903608',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-160903608-project-member',image_user_id='72663ad9bd9945b098337e0ebe4bef19',owner_project_name='tempest-TestStampPattern-160903608',owner_user_name='tempest-TestStampPattern-160903608-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:45:51Z,user_data=None,user_id='72663ad9bd9945b098337e0ebe4bef19',uuid=969317c7-66b5-4077-880b-abb157ef9bbb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "address": "fa:16:3e:8d:83:db", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210aa08-7e", "ovs_interfaceid": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Converting VIF {"id": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "address": "fa:16:3e:8d:83:db", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf210aa08-7e", "ovs_interfaceid": "f210aa08-7e18-4f24-99f2-b82a5a8c735a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:83:db,bridge_name='br-int',has_traffic_filtering=True,id=f210aa08-7e18-4f24-99f2-b82a5a8c735a,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210aa08-7e') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG os_vif [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:83:db,bridge_name='br-int',has_traffic_filtering=True,id=f210aa08-7e18-4f24-99f2-b82a5a8c735a,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210aa08-7e') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf210aa08-7e, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:48:43 user nova-compute[73520]: INFO os_vif [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:83:db,bridge_name='br-int',has_traffic_filtering=True,id=f210aa08-7e18-4f24-99f2-b82a5a8c735a,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf210aa08-7e')
Aug 16 12:48:43 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Deleting instance files /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb_del
Aug 16 12:48:43 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Deletion of /opt/stack/data/nova/instances/969317c7-66b5-4077-880b-abb157ef9bbb_del complete
Aug 16 12:48:43 user nova-compute[73520]: INFO nova.compute.manager [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 16 12:48:43 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:48:44 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Took 0.59 seconds to deallocate network for instance.
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-e0f72f30-d2ea-43a7-8d8e-5f8028880b13 req-09d40d8e-b440-4769-9066-a6243c8bc854 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received event network-vif-deleted-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:48:44 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Deleted allocations for instance 969317c7-66b5-4077-880b-abb157ef9bbb
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-a36df5a8-c370-4e9c-8c34-73fe92f1d945 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "969317c7-66b5-4077-880b-abb157ef9bbb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.872s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received event network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] Acquiring lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] No waiting events found dispatching network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:48:44 user nova-compute[73520]: WARNING nova.compute.manager [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received unexpected event network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a for instance with vm_state deleted and task_state None.
Aug 16 12:48:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received event network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] Acquiring lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] No waiting events found dispatching network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:48:44 user nova-compute[73520]: WARNING nova.compute.manager [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received unexpected event network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a for instance with vm_state deleted and task_state None.
Aug 16 12:48:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received event network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] Acquiring lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] No waiting events found dispatching network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:48:44 user nova-compute[73520]: WARNING nova.compute.manager [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received unexpected event network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a for instance with vm_state deleted and task_state None.
Aug 16 12:48:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received event network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] Acquiring lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] Lock "969317c7-66b5-4077-880b-abb157ef9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:48:44 user nova-compute[73520]: DEBUG nova.compute.manager [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] No waiting events found dispatching network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:48:44 user nova-compute[73520]: WARNING nova.compute.manager [req-e64d4d4c-7595-4113-8057-75b3b68b90de req-ee6ae792-70b3-4c43-a40a-9e1d67970de0 service nova] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Received unexpected event network-vif-plugged-f210aa08-7e18-4f24-99f2-b82a5a8c735a for instance with vm_state deleted and task_state None.
Aug 16 12:48:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:48:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:48:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:48:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:48:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:48:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:48:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:48:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:48:57 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:48:58 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692190123.3084562, 969317c7-66b5-4077-880b-abb157ef9bbb => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:48:58 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] VM Stopped (Lifecycle Event)
Aug 16 12:48:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-9e0b321e-f4b6-41ab-8298-5ff7dbae4b3f None None] [instance: 969317c7-66b5-4077-880b-abb157ef9bbb] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:48:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:48:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:00 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:01 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:03 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:49:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:49:03 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:49:03 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:49:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:49:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:49:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:49:04 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:49:04 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:49:04 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:49:04 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=25.16551971435547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:49:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:49:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:49:05 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:49:05 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:49:05 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:49:05 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing inventories for resource provider 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 12:49:05 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating ProviderTree inventory for provider 70dde5f5-9594-47c3-954e-598dd3089747 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 12:49:05 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 12:49:05 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing aggregate associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, aggregates: None {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 12:49:05 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing trait associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 12:49:05 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:49:05 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:49:05 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:49:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:49:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:10 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:49:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 12:49:10 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:14 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:17 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 12:49:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] There are 0 instances to clean {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 12:49:18 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 38a325f8-e3cc-4033-92dd-dd47b6b4190c {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:49:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:49:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:49:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:49:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:49:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:29 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 12:49:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:49:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:49:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-f3441103-e499-4dd1-a446-7af6a65f12f2 req-11e019ba-34b2-4f24-91eb-079a8c2fa8af service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Received event network-changed-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG nova.compute.manager [req-f3441103-e499-4dd1-a446-7af6a65f12f2 req-11e019ba-34b2-4f24-91eb-079a8c2fa8af service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Refreshing instance network info cache due to event network-changed-452f5c2d-20dc-4ac6-b875-a200d55f0cc0. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f3441103-e499-4dd1-a446-7af6a65f12f2 req-11e019ba-34b2-4f24-91eb-079a8c2fa8af service nova] Acquiring lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f3441103-e499-4dd1-a446-7af6a65f12f2 req-11e019ba-34b2-4f24-91eb-079a8c2fa8af service nova] Acquired lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG nova.network.neutron [req-f3441103-e499-4dd1-a446-7af6a65f12f2 req-11e019ba-34b2-4f24-91eb-079a8c2fa8af service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Refreshing network info cache for port 452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:49:50 user nova-compute[73520]: INFO nova.compute.manager [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Terminating instance
Aug 16 12:49:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:51 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Instance destroyed successfully.
Aug 16 12:49:51 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lazy-loading 'resources' on Instance uuid 38a325f8-e3cc-4033-92dd-dd47b6b4190c {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:49:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1421016579',display_name='tempest-TestStampPattern-server-1421016579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1421016579',id=48,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwRMExwQxQHRu0VQoTRBe9PUDpaEXm/5+Y0L1d60IAAQB1PQGosro0QC3rWNctmtdmkB0qFbKn1mN5TkKQK3A37SWFY5Z4Uqe3buZVFP2WzkA3jc3jRmdmYRx8pXMqNWw==',key_name='tempest-TestStampPattern-1822850313',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:42:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1282c7409c44eae81facffc98d5edc7',ramdisk_id='',reservation_id='r-1qviih9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-160903608',owner_user_name='tempest-TestStampPattern-160903608-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:45:42Z,user_data=None,user_id='72663ad9bd9945b098337e0ebe4bef19',uuid=38a325f8-e3cc-4033-92dd-dd47b6b4190c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:49:51 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Converting VIF {"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:49:51 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:75:76,bridge_name='br-int',has_traffic_filtering=True,id=452f5c2d-20dc-4ac6-b875-a200d55f0cc0,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452f5c2d-20') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:49:51 user nova-compute[73520]: DEBUG os_vif [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:75:76,bridge_name='br-int',has_traffic_filtering=True,id=452f5c2d-20dc-4ac6-b875-a200d55f0cc0,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452f5c2d-20') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:49:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap452f5c2d-20, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:49:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:49:51 user nova-compute[73520]: INFO os_vif [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:75:76,bridge_name='br-int',has_traffic_filtering=True,id=452f5c2d-20dc-4ac6-b875-a200d55f0cc0,network=Network(5f962068-17dd-4aea-8b92-4ad047d5f38b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452f5c2d-20')
Aug 16 12:49:51 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Deleting instance files /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c_del
Aug 16 12:49:51 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Deletion of /opt/stack/data/nova/instances/38a325f8-e3cc-4033-92dd-dd47b6b4190c_del complete
Aug 16 12:49:51 user nova-compute[73520]: INFO nova.compute.manager [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 12:49:51 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:49:51 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:49:51 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:49:51 user nova-compute[73520]: DEBUG nova.network.neutron [req-f3441103-e499-4dd1-a446-7af6a65f12f2 req-11e019ba-34b2-4f24-91eb-079a8c2fa8af service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updated VIF entry in instance network info cache for port 452f5c2d-20dc-4ac6-b875-a200d55f0cc0. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:49:51 user nova-compute[73520]: DEBUG nova.network.neutron [req-f3441103-e499-4dd1-a446-7af6a65f12f2 req-11e019ba-34b2-4f24-91eb-079a8c2fa8af service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updating instance_info_cache with network_info: [{"id": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "address": "fa:16:3e:51:75:76", "network": {"id": "5f962068-17dd-4aea-8b92-4ad047d5f38b", "bridge": "br-int", "label": "tempest-TestStampPattern-727015725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1282c7409c44eae81facffc98d5edc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452f5c2d-20", "ovs_interfaceid": "452f5c2d-20dc-4ac6-b875-a200d55f0cc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:49:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-f3441103-e499-4dd1-a446-7af6a65f12f2 req-11e019ba-34b2-4f24-91eb-079a8c2fa8af service nova] Releasing lock "refresh_cache-38a325f8-e3cc-4033-92dd-dd47b6b4190c" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:49:52 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Took 0.57 seconds to deallocate network for instance.
Aug 16 12:49:52 user nova-compute[73520]: DEBUG nova.compute.manager [req-78b1d59b-8c0a-45c3-b5a0-c74af51fd0cb req-a7a306dc-3139-4f06-a551-31042ef42b03 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Received event network-vif-deleted-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:49:52 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Deleted allocations for instance 38a325f8-e3cc-4033-92dd-dd47b6b4190c
Aug 16 12:49:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f483fd9e-e8e3-43a4-b019-ac5226bbb062 tempest-TestStampPattern-160903608 tempest-TestStampPattern-160903608-project-member] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.717s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG nova.compute.manager [req-ed46a266-ce53-452e-8d57-016f2d049456 req-f85f7509-ade4-4807-8109-7da5d945c113 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Received event network-vif-unplugged-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed46a266-ce53-452e-8d57-016f2d049456 req-f85f7509-ade4-4807-8109-7da5d945c113 service nova] Acquiring lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed46a266-ce53-452e-8d57-016f2d049456 req-f85f7509-ade4-4807-8109-7da5d945c113 service nova] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed46a266-ce53-452e-8d57-016f2d049456 req-f85f7509-ade4-4807-8109-7da5d945c113 service nova] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG nova.compute.manager [req-ed46a266-ce53-452e-8d57-016f2d049456 req-f85f7509-ade4-4807-8109-7da5d945c113 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] No waiting events found dispatching network-vif-unplugged-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:49:52 user nova-compute[73520]: WARNING nova.compute.manager [req-ed46a266-ce53-452e-8d57-016f2d049456 req-f85f7509-ade4-4807-8109-7da5d945c113 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Received unexpected event network-vif-unplugged-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 for instance with vm_state deleted and task_state None.
Aug 16 12:49:52 user nova-compute[73520]: DEBUG nova.compute.manager [req-ed46a266-ce53-452e-8d57-016f2d049456 req-f85f7509-ade4-4807-8109-7da5d945c113 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Received event network-vif-plugged-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed46a266-ce53-452e-8d57-016f2d049456 req-f85f7509-ade4-4807-8109-7da5d945c113 service nova] Acquiring lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed46a266-ce53-452e-8d57-016f2d049456 req-f85f7509-ade4-4807-8109-7da5d945c113 service nova] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ed46a266-ce53-452e-8d57-016f2d049456 req-f85f7509-ade4-4807-8109-7da5d945c113 service nova] Lock "38a325f8-e3cc-4033-92dd-dd47b6b4190c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:49:52 user nova-compute[73520]: DEBUG nova.compute.manager [req-ed46a266-ce53-452e-8d57-016f2d049456 req-f85f7509-ade4-4807-8109-7da5d945c113 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] No waiting events found dispatching network-vif-plugged-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:49:52 user nova-compute[73520]: WARNING nova.compute.manager [req-ed46a266-ce53-452e-8d57-016f2d049456 req-f85f7509-ade4-4807-8109-7da5d945c113 service nova] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Received unexpected event network-vif-plugged-452f5c2d-20dc-4ac6-b875-a200d55f0cc0 for instance with vm_state deleted and task_state None.
Aug 16 12:49:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:55 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:49:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:49:59 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:49:59 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:50:00 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:50:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:50:02 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:50:05 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:50:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:50:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:50:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:50:05 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:50:06 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:50:06 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:50:06 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=25.280689239501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692190191.3956563, 38a325f8-e3cc-4033-92dd-dd47b6b4190c => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:50:06 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] VM Stopped (Lifecycle Event)
Aug 16 12:50:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-0b663d11-ea90-4606-809d-ffe5b3ee2a7e None None] [instance: 38a325f8-e3cc-4033-92dd-dd47b6b4190c] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:50:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:50:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:11 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:50:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:50:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:50:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 12:50:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:50:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:50:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:50:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:50:52 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:50:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:50:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:50:52 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:50:52 user nova-compute[73520]: INFO nova.compute.claims [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Claim successful on node user
Aug 16 12:50:53 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:50:53 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:50:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:50:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:50:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:50:53 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:50:53 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:50:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:50:53 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:50:53 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:50:53 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Creating image(s)
Aug 16 12:50:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:50:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "/opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:50:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "/opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:50:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "ea4cc35aec40f093fe09349f1981d7f4d1f80144" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:50:53 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "ea4cc35aec40f093fe09349f1981d7f4d1f80144" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:50:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144.part --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:50:54 user nova-compute[73520]: DEBUG nova.policy [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f1af5415b9c4b0482e5de17486f35bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a44a0eef8e904053aec96049461d1002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:50:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144.part --force-share --output=json" returned: 0 in 0.184s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:50:54 user nova-compute[73520]: DEBUG nova.virt.images [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] 5663b9a9-85d1-43e7-ba6e-206a76918a45 was qcow2, converting to raw {{(pid=73520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 12:50:54 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:50:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144.part /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144.converted {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:50:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:54 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Successfully created port: f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:50:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144.part /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144.converted" returned: 0 in 0.626s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:50:54 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144.converted --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:50:54 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "ea4cc35aec40f093fe09349f1981d7f4d1f80144" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.614s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144 --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "ea4cc35aec40f093fe09349f1981d7f4d1f80144" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "ea4cc35aec40f093fe09349f1981d7f4d1f80144" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144 --force-share --output=json" returned: 0 in 0.217s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144,backing_fmt=raw /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144,backing_fmt=raw /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk 1073741824" returned: 0 in 0.052s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "ea4cc35aec40f093fe09349f1981d7f4d1f80144" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144 --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Successfully updated port: f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG nova.compute.manager [req-1cc0ad03-9ce5-42ab-9427-19538ab2e6fb req-9331ccb2-bca8-4686-a117-27668cb8ada4 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-changed-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG nova.compute.manager [req-1cc0ad03-9ce5-42ab-9427-19538ab2e6fb req-9331ccb2-bca8-4686-a117-27668cb8ada4 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Refreshing instance network info cache due to event network-changed-f835a02c-1d68-4de6-9905-0e0b3463f15e. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1cc0ad03-9ce5-42ab-9427-19538ab2e6fb req-9331ccb2-bca8-4686-a117-27668cb8ada4 service nova] Acquiring lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1cc0ad03-9ce5-42ab-9427-19538ab2e6fb req-9331ccb2-bca8-4686-a117-27668cb8ada4 service nova] Acquired lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG nova.network.neutron [req-1cc0ad03-9ce5-42ab-9427-19538ab2e6fb req-9331ccb2-bca8-4686-a117-27668cb8ada4 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Refreshing network info cache for port f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG nova.network.neutron [req-1cc0ad03-9ce5-42ab-9427-19538ab2e6fb req-9331ccb2-bca8-4686-a117-27668cb8ada4 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Cannot resize image /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG nova.objects.instance [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'migration_context' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Ensure instance console log exists: /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:50:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.network.neutron [req-1cc0ad03-9ce5-42ab-9427-19538ab2e6fb req-9331ccb2-bca8-4686-a117-27668cb8ada4 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1cc0ad03-9ce5-42ab-9427-19538ab2e6fb req-9331ccb2-bca8-4686-a117-27668cb8ada4 service nova] Releasing lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquired lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating instance_info_cache with network_info: [{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Releasing lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Instance network_info: |[{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Start _get_guest_xml network_info=[{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:50:49Z,direct_url=<?>,disk_format='qcow2',id=5663b9a9-85d1-43e7-ba6e-206a76918a45,min_disk=0,min_ram=0,name='tempest-scenario-img--723094751',owner='a44a0eef8e904053aec96049461d1002',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:50:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': '5663b9a9-85d1-43e7-ba6e-206a76918a45'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:50:56 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:50:56 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:50:49Z,direct_url=<?>,disk_format='qcow2',id=5663b9a9-85d1-43e7-ba6e-206a76918a45,min_disk=0,min_ram=0,name='tempest-scenario-img--723094751',owner='a44a0eef8e904053aec96049461d1002',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:50:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2137004591',display_name='tempest-TestMinimumBasicScenario-server-2137004591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2137004591',id=51,image_ref='5663b9a9-85d1-43e7-ba6e-206a76918a45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlnGVuvbH0vR5Es4TjK0/O6qIVS+YKvYBBqvpzJSEIkREmcSWgLO+Qp8B/hcBxNcJztloIz5EkO4XaP8EG+w0ZzLECnvfV1f5O4NWFazUmqp3lu4gtwl5NdhvywV6NrSQ==',key_name='tempest-TestMinimumBasicScenario-274639821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a44a0eef8e904053aec96049461d1002',ramdisk_id='',reservation_id='r-094najxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5663b9a9-85d1-43e7-ba6e-206a76918a45',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-847669298',owner_user_name='tempest-TestMinimumBasicScenario-847669298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:50:53Z,user_data=None,user_id='9f1af5415b9c4b0482e5de17486f35bc',uuid=8b59377e-6ff4-444b-8860-ea883a5a5f2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converting VIF {"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.objects.instance [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:50:56 user nova-compute[73520]:   <uuid>8b59377e-6ff4-444b-8860-ea883a5a5f2f</uuid>
Aug 16 12:50:56 user nova-compute[73520]:   <name>instance-00000033</name>
Aug 16 12:50:56 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:50:56 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:50:56 user nova-compute[73520]:   <metadata>
Aug 16 12:50:56 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:50:56 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:50:56 user nova-compute[73520]:       <nova:name>tempest-TestMinimumBasicScenario-server-2137004591</nova:name>
Aug 16 12:50:56 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:50:56</nova:creationTime>
Aug 16 12:50:56 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:50:56 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:50:56 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:50:56 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:50:56 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:50:56 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:50:56 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:50:56 user nova-compute[73520]:       <nova:owner>
Aug 16 12:50:56 user nova-compute[73520]:         <nova:user uuid="9f1af5415b9c4b0482e5de17486f35bc">tempest-TestMinimumBasicScenario-847669298-project-member</nova:user>
Aug 16 12:50:56 user nova-compute[73520]:         <nova:project uuid="a44a0eef8e904053aec96049461d1002">tempest-TestMinimumBasicScenario-847669298</nova:project>
Aug 16 12:50:56 user nova-compute[73520]:       </nova:owner>
Aug 16 12:50:56 user nova-compute[73520]:       <nova:root type="image" uuid="5663b9a9-85d1-43e7-ba6e-206a76918a45"/>
Aug 16 12:50:56 user nova-compute[73520]:       <nova:ports>
Aug 16 12:50:56 user nova-compute[73520]:         <nova:port uuid="f835a02c-1d68-4de6-9905-0e0b3463f15e">
Aug 16 12:50:56 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 12:50:56 user nova-compute[73520]:         </nova:port>
Aug 16 12:50:56 user nova-compute[73520]:       </nova:ports>
Aug 16 12:50:56 user nova-compute[73520]:     </nova:instance>
Aug 16 12:50:56 user nova-compute[73520]:   </metadata>
Aug 16 12:50:56 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:50:56 user nova-compute[73520]:     <system>
Aug 16 12:50:56 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:50:56 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:50:56 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:50:56 user nova-compute[73520]:       <entry name="serial">8b59377e-6ff4-444b-8860-ea883a5a5f2f</entry>
Aug 16 12:50:56 user nova-compute[73520]:       <entry name="uuid">8b59377e-6ff4-444b-8860-ea883a5a5f2f</entry>
Aug 16 12:50:56 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:50:56 user nova-compute[73520]:     </system>
Aug 16 12:50:56 user nova-compute[73520]:   </sysinfo>
Aug 16 12:50:56 user nova-compute[73520]:   <os>
Aug 16 12:50:56 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:50:56 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:50:56 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:50:56 user nova-compute[73520]:   </os>
Aug 16 12:50:56 user nova-compute[73520]:   <features>
Aug 16 12:50:56 user nova-compute[73520]:     <acpi/>
Aug 16 12:50:56 user nova-compute[73520]:     <apic/>
Aug 16 12:50:56 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:50:56 user nova-compute[73520]:   </features>
Aug 16 12:50:56 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:50:56 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:50:56 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:50:56 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:50:56 user nova-compute[73520]:   </clock>
Aug 16 12:50:56 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:50:56 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:50:56 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:50:56 user nova-compute[73520]:   </cpu>
Aug 16 12:50:56 user nova-compute[73520]:   <devices>
Aug 16 12:50:56 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:50:56 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:50:56 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk"/>
Aug 16 12:50:56 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:50:56 user nova-compute[73520]:     </disk>
Aug 16 12:50:56 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:50:56 user nova-compute[73520]:       <mac address="fa:16:3e:87:4f:c2"/>
Aug 16 12:50:56 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:50:56 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:50:56 user nova-compute[73520]:       <target dev="tapf835a02c-1d"/>
Aug 16 12:50:56 user nova-compute[73520]:     </interface>
Aug 16 12:50:56 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:50:56 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/console.log" append="off"/>
Aug 16 12:50:56 user nova-compute[73520]:     </serial>
Aug 16 12:50:56 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:50:56 user nova-compute[73520]:     <video>
Aug 16 12:50:56 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:50:56 user nova-compute[73520]:     </video>
Aug 16 12:50:56 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:50:56 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:50:56 user nova-compute[73520]:     </rng>
Aug 16 12:50:56 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:50:56 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:50:56 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:50:56 user nova-compute[73520]:     </memballoon>
Aug 16 12:50:56 user nova-compute[73520]:   </devices>
Aug 16 12:50:56 user nova-compute[73520]: </domain>
Aug 16 12:50:56 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2137004591',display_name='tempest-TestMinimumBasicScenario-server-2137004591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2137004591',id=51,image_ref='5663b9a9-85d1-43e7-ba6e-206a76918a45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlnGVuvbH0vR5Es4TjK0/O6qIVS+YKvYBBqvpzJSEIkREmcSWgLO+Qp8B/hcBxNcJztloIz5EkO4XaP8EG+w0ZzLECnvfV1f5O4NWFazUmqp3lu4gtwl5NdhvywV6NrSQ==',key_name='tempest-TestMinimumBasicScenario-274639821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a44a0eef8e904053aec96049461d1002',ramdisk_id='',reservation_id='r-094najxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5663b9a9-85d1-43e7-ba6e-206a76918a45',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-847669298',owner_user_name='tempest-TestMinimumBasicScenario-847669298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:50:53Z,user_data=None,user_id='9f1af5415b9c4b0482e5de17486f35bc',uuid=8b59377e-6ff4-444b-8860-ea883a5a5f2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converting VIF {"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG os_vif [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf835a02c-1d, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf835a02c-1d, col_values=(('external_ids', {'iface-id': 'f835a02c-1d68-4de6-9905-0e0b3463f15e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:4f:c2', 'vm-uuid': '8b59377e-6ff4-444b-8860-ea883a5a5f2f'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:56 user nova-compute[73520]: INFO os_vif [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d')
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] No VIF found with MAC fa:16:3e:87:4f:c2, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:50:56 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:50:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-0bc4b408-6789-486d-98b1-7dc0fef49f7c req-b0dbaa07-be1b-4ac9-8d45-f6dfa1ce779a service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:50:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0bc4b408-6789-486d-98b1-7dc0fef49f7c req-b0dbaa07-be1b-4ac9-8d45-f6dfa1ce779a service nova] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:50:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0bc4b408-6789-486d-98b1-7dc0fef49f7c req-b0dbaa07-be1b-4ac9-8d45-f6dfa1ce779a service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:50:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-0bc4b408-6789-486d-98b1-7dc0fef49f7c req-b0dbaa07-be1b-4ac9-8d45-f6dfa1ce779a service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:50:58 user nova-compute[73520]: DEBUG nova.compute.manager [req-0bc4b408-6789-486d-98b1-7dc0fef49f7c req-b0dbaa07-be1b-4ac9-8d45-f6dfa1ce779a service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] No waiting events found dispatching network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:50:58 user nova-compute[73520]: WARNING nova.compute.manager [req-0bc4b408-6789-486d-98b1-7dc0fef49f7c req-b0dbaa07-be1b-4ac9-8d45-f6dfa1ce779a service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received unexpected event network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e for instance with vm_state building and task_state spawning.
Aug 16 12:50:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:50:59 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:50:59 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692190260.228535, 8b59377e-6ff4-444b-8860-ea883a5a5f2f => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:51:00 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] VM Resumed (Lifecycle Event)
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:51:00 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Instance spawned successfully.
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:51:00 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692190260.2288, 8b59377e-6ff4-444b-8860-ea883a5a5f2f => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:51:00 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] VM Started (Lifecycle Event)
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:51:00 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:51:00 user nova-compute[73520]: INFO nova.compute.manager [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Took 6.94 seconds to spawn the instance on the hypervisor.
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-c1876d83-3157-401e-96f9-13f6cfbabe0c req-a20bfb2b-7f07-4dc0-b576-9633df85a822 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c1876d83-3157-401e-96f9-13f6cfbabe0c req-a20bfb2b-7f07-4dc0-b576-9633df85a822 service nova] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c1876d83-3157-401e-96f9-13f6cfbabe0c req-a20bfb2b-7f07-4dc0-b576-9633df85a822 service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c1876d83-3157-401e-96f9-13f6cfbabe0c req-a20bfb2b-7f07-4dc0-b576-9633df85a822 service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:51:00 user nova-compute[73520]: DEBUG nova.compute.manager [req-c1876d83-3157-401e-96f9-13f6cfbabe0c req-a20bfb2b-7f07-4dc0-b576-9633df85a822 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] No waiting events found dispatching network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:51:00 user nova-compute[73520]: WARNING nova.compute.manager [req-c1876d83-3157-401e-96f9-13f6cfbabe0c req-a20bfb2b-7f07-4dc0-b576-9633df85a822 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received unexpected event network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e for instance with vm_state building and task_state spawning.
Aug 16 12:51:00 user nova-compute[73520]: INFO nova.compute.manager [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Took 7.49 seconds to build instance.
Aug 16 12:51:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2f95aa87-6555-4ec4-b345-8900484a8027 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.598s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:51:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:02 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:51:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:04 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:51:05 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:51:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:51:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:51:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:51:05 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:51:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:51:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:51:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:51:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:51:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:06 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:51:06 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:51:06 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8859MB free_disk=25.21585464477539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:51:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:51:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:51:06 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 8b59377e-6ff4-444b-8860-ea883a5a5f2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:51:06 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:51:06 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:51:06 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:51:06 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:51:07 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:51:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:51:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:13 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:51:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:51:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:51:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:51:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:51:13 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:51:13 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:51:13 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating instance_info_cache with network_info: [{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:51:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:51:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:51:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:51:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:51:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:51:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:51:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:17 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:51:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:51:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:51:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:51:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:51:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:51:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:51:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:51:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:51:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:51:57 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:51:57 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:52:00 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:52:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:52:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:52:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:52:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:52:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:52:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:52:01 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:52:03 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:52:05 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:52:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:52:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:52:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:52:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:52:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:52:06 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:52:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:07 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:52:07 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:52:07 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=25.18744659423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:52:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:52:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:52:07 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 8b59377e-6ff4-444b-8860-ea883a5a5f2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:52:07 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:52:07 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:52:08 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:52:08 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:52:08 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:52:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:52:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:52:14 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:52:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:52:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:52:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:52:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:52:14 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:52:14 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:52:14 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating instance_info_cache with network_info: [{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:52:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:52:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:52:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:52:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:52:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:52:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:52:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:52:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:52:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:52:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:52:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:52:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:52:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:52:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'flavor' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:52:48 user nova-compute[73520]: INFO nova.compute.manager [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Attaching volume d3a4d32d-d103-45ee-a3b7-19be099c0357 to /dev/vdb
Aug 16 12:52:48 user nova-compute[73520]: DEBUG os_brick.utils [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee3fce6-d044-4084-92b6-104eb276fbfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[266b0334-1fe0-471d-97d4-d3168df5496e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e695811f-4201-4759-aa10-eb20d9edf30c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[09615b4a-0f62-495d-9796-da4a61f25a73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:52:48 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:52:48 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fca8ff-1a3e-4332-b0c6-9327bf068aa2]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG os_brick.utils [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:52:48 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating existing volume attachment record: 09c19d60-9cfb-4f0c-bf13-2149f8f3f720 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:52:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:52:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:52:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:52:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:52:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:52:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:52:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:52:56 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YkUMqVOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:52:58 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:52:58 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:52:58 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4477deb1-1d69-4046-80d0-20d841ff1510]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:52:58 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2922e0d-9a95-4a85-acdc-f06f55a4a629]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357] added
Aug 16 12:52:58 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6531f4e6-b908-40d8-9f87-3aff030472f8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b295915-2b5d-4c00-9fc6-92a441d6f4f8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YkUMqVOs {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YkUMqVOs" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f89613-53f8-4d6e-a3f1-49a7b3ddfc4d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YkUMqVOs'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f627e8-578c-438f-9695-496839603f15]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d108c385-5d1d-4b48-b9df-9fe05b5ff96b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:52:58 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:52:58 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:52:58 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 12:52:58 user nova-compute[73520]: 
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c75de88-7d05-4a3b-8a6c-0c208a5c9b49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260]
Aug 16 12:52:58 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260] successful.
Aug 16 12:52:58 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[643b108f-8fe2-4e18-9fd0-eb706a5975d9]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[305a8509-1f9d-466f-bebd-747091db0060]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 (non-flash)
Aug 16 12:52:58 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 (non-flash)
Aug 16 12:52:58 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[03df6df6-84db-43ad-ae32-dd12f04d264d]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:52:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:52:59 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:52:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YkUMqVOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:52:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:52:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23835366665663736', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:52:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835366665663736', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:52:59 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'flavor' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:52:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:52:59 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:52:59 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:52:59 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:52:59 user nova-compute[73520]:   <serial>d3a4d32d-d103-45ee-a3b7-19be099c0357</serial>
Aug 16 12:52:59 user nova-compute[73520]: </disk>
Aug 16 12:52:59 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:52:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:52:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:52:59 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] No VIF found with MAC fa:16:3e:87:4f:c2, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:52:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f7c9e5b9-4377-417e-9aaa-693bd29fa6d0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.439s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:53:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:53:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:53:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:53:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:53:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:53:02 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:53:03 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:53:04 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:53:05 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:53:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:53:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:53:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:53:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:53:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:53:06 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:53:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:53:07 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:53:07 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:53:07 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=25.186492919921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:53:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:53:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:53:07 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 8b59377e-6ff4-444b-8860-ea883a5a5f2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:53:07 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:53:07 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:53:07 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:53:07 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:53:08 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:53:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:53:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-ab7a5a45-604d-45a3-a06c-bbd30df78d1d req-312ba560-57d5-4dd6-af3a-c3e4768df86c service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-changed-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:53:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-ab7a5a45-604d-45a3-a06c-bbd30df78d1d req-312ba560-57d5-4dd6-af3a-c3e4768df86c service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Refreshing instance network info cache due to event network-changed-f835a02c-1d68-4de6-9905-0e0b3463f15e. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:53:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ab7a5a45-604d-45a3-a06c-bbd30df78d1d req-312ba560-57d5-4dd6-af3a-c3e4768df86c service nova] Acquiring lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:53:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ab7a5a45-604d-45a3-a06c-bbd30df78d1d req-312ba560-57d5-4dd6-af3a-c3e4768df86c service nova] Acquired lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:53:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-ab7a5a45-604d-45a3-a06c-bbd30df78d1d req-312ba560-57d5-4dd6-af3a-c3e4768df86c service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Refreshing network info cache for port f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:53:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-ab7a5a45-604d-45a3-a06c-bbd30df78d1d req-312ba560-57d5-4dd6-af3a-c3e4768df86c service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updated VIF entry in instance network info cache for port f835a02c-1d68-4de6-9905-0e0b3463f15e. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:53:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-ab7a5a45-604d-45a3-a06c-bbd30df78d1d req-312ba560-57d5-4dd6-af3a-c3e4768df86c service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating instance_info_cache with network_info: [{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:53:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-ab7a5a45-604d-45a3-a06c-bbd30df78d1d req-312ba560-57d5-4dd6-af3a-c3e4768df86c service nova] Releasing lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:53:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-189fde5a-807f-426d-9a2b-e22e27ab0a5c req-75cb9c30-2c65-47ef-a607-a0e4c59a5d25 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-changed-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:53:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-189fde5a-807f-426d-9a2b-e22e27ab0a5c req-75cb9c30-2c65-47ef-a607-a0e4c59a5d25 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Refreshing instance network info cache due to event network-changed-f835a02c-1d68-4de6-9905-0e0b3463f15e. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:53:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-189fde5a-807f-426d-9a2b-e22e27ab0a5c req-75cb9c30-2c65-47ef-a607-a0e4c59a5d25 service nova] Acquiring lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:53:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-189fde5a-807f-426d-9a2b-e22e27ab0a5c req-75cb9c30-2c65-47ef-a607-a0e4c59a5d25 service nova] Acquired lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:53:13 user nova-compute[73520]: DEBUG nova.network.neutron [req-189fde5a-807f-426d-9a2b-e22e27ab0a5c req-75cb9c30-2c65-47ef-a607-a0e4c59a5d25 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Refreshing network info cache for port f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:53:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-189fde5a-807f-426d-9a2b-e22e27ab0a5c req-75cb9c30-2c65-47ef-a607-a0e4c59a5d25 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updated VIF entry in instance network info cache for port f835a02c-1d68-4de6-9905-0e0b3463f15e. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:53:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-189fde5a-807f-426d-9a2b-e22e27ab0a5c req-75cb9c30-2c65-47ef-a607-a0e4c59a5d25 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating instance_info_cache with network_info: [{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:53:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-189fde5a-807f-426d-9a2b-e22e27ab0a5c req-75cb9c30-2c65-47ef-a607-a0e4c59a5d25 service nova] Releasing lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:53:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:15 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:53:15 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:53:15 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:53:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:53:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:53:15 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:53:15 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:53:15 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating instance_info_cache with network_info: [{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:53:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:53:15 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:53:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:18 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:53:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:53:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:53:19 user nova-compute[73520]: INFO nova.compute.manager [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Rebooting instance
Aug 16 12:53:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:53:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquired lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:53:19 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:53:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating instance_info_cache with network_info: [{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:53:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Releasing lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:53:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:53:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-44273ed3-692a-4a1b-ad7f-36d475800632 req-0813e6c8-b7bf-40e7-a084-c13dda5e1a52 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-vif-unplugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:53:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-44273ed3-692a-4a1b-ad7f-36d475800632 req-0813e6c8-b7bf-40e7-a084-c13dda5e1a52 service nova] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:53:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-44273ed3-692a-4a1b-ad7f-36d475800632 req-0813e6c8-b7bf-40e7-a084-c13dda5e1a52 service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:53:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-44273ed3-692a-4a1b-ad7f-36d475800632 req-0813e6c8-b7bf-40e7-a084-c13dda5e1a52 service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:53:20 user nova-compute[73520]: DEBUG nova.compute.manager [req-44273ed3-692a-4a1b-ad7f-36d475800632 req-0813e6c8-b7bf-40e7-a084-c13dda5e1a52 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] No waiting events found dispatching network-vif-unplugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:53:20 user nova-compute[73520]: WARNING nova.compute.manager [req-44273ed3-692a-4a1b-ad7f-36d475800632 req-0813e6c8-b7bf-40e7-a084-c13dda5e1a52 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received unexpected event network-vif-unplugged-f835a02c-1d68-4de6-9905-0e0b3463f15e for instance with vm_state active and task_state reboot_started_hard.
Aug 16 12:53:21 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Instance destroyed successfully.
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.objects.instance [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'resources' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2137004591',display_name='tempest-TestMinimumBasicScenario-server-2137004591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2137004591',id=51,image_ref='5663b9a9-85d1-43e7-ba6e-206a76918a45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlnGVuvbH0vR5Es4TjK0/O6qIVS+YKvYBBqvpzJSEIkREmcSWgLO+Qp8B/hcBxNcJztloIz5EkO4XaP8EG+w0ZzLECnvfV1f5O4NWFazUmqp3lu4gtwl5NdhvywV6NrSQ==',key_name='tempest-TestMinimumBasicScenario-274639821',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:51:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a44a0eef8e904053aec96049461d1002',ramdisk_id='',reservation_id='r-094najxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5663b9a9-85d1-43e7-ba6e-206a76918a45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-847669298',owner_user_name='tempest-TestMinimumBasicScenario-847669298-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:53:20Z,user_data=None,user_id='9f1af5415b9c4b0482e5de17486f35bc',uuid=8b59377e-6ff4-444b-8860-ea883a5a5f2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converting VIF {"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_vif [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf835a02c-1d, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:53:21 user nova-compute[73520]: INFO os_vif [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d')
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YkUMqVOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:53:21 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ffeb4d-b99c-488c-b2ba-ebb1a2888a5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcafd82-912a-4d84-a2c9-60ad855cf1c7]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 (non-flash)
Aug 16 12:53:21 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 (non-flash)
Aug 16 12:53:21 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c4bc9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d7e25a-a972-4a0d-ac18-caca77d819fc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e2e9c3-1225-44e1-b6de-81ab8e6848d0]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e858560e-ae7b-4d26-8985-970adf126719]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c869f9-0c38-43db-94b9-755d8fabd326]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dbab28-3d98-45f3-97e3-ffe34a788220]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9681c288-9750-43be-9f4b-619fcdd5fddc]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260]
Aug 16 12:53:21 user nova-compute[73520]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260] successful.
Aug 16 12:53:21 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcba7f0-4b1a-401a-9afd-e75081397912]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] <== disconnect_volume: return (267ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Start _get_guest_xml network_info=[{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5663b9a9-85d1-43e7-ba6e-206a76918a45,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': '5663b9a9-85d1-43e7-ba6e-206a76918a45'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YkUMqVOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8b59377e-6ff4-444b-8860-ea883a5a5f2f', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3a4d32d-d103-45ee-a3b7-19be099c0357', 'serial': 'd3a4d32d-d103-45ee-a3b7-19be099c0357'}, 'attachment_id': '09c19d60-9cfb-4f0c-bf13-2149f8f3f720', 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:53:21 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:53:21 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5663b9a9-85d1-43e7-ba6e-206a76918a45,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.objects.instance [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YkUMqVOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:53:21 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:53:21 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:53:21 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d983141-cdd2-40a5-92b1-45e18bc2ccd3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:53:21 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c44adbb-9bc0-4139-962f-6d034e4b7ad8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357] added
Aug 16 12:53:21 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0795e8a1-090c-4c45-b098-416fafd8aae1]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8923cb92-f24a-4640-b473-df4be81140db]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YkUMqVOs {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YkUMqVOs" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4464aa-5a9d-412b-bb73-6972644a18e7]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YkUMqVOs'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[835cac78-1933-4eb7-b067-408556f12c19]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ddd56b-974a-426f-a5b3-b0c1ce9ee4d9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:53:21 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:53:21 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:53:21 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 12:53:21 user nova-compute[73520]: 
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d219057-3678-4a0b-8e20-95b0a7c76398]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260]
Aug 16 12:53:21 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260] successful.
Aug 16 12:53:21 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda191f3-b66a-4c42-80c5-e27cd3bfaf51]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac90e00-120c-497b-9c4a-fdf18045dec1]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 (non-flash)
Aug 16 12:53:21 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 (non-flash)
Aug 16 12:53:21 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ebc8cf-ed62-4f4a-b5fe-a23d93f54ad4]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:53:21 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-d2a1c61d-65d4-430f-9f1c-9311a90fc192 req-4e78123a-94bf-419d-83ca-3878d958cc14 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d2a1c61d-65d4-430f-9f1c-9311a90fc192 req-4e78123a-94bf-419d-83ca-3878d958cc14 service nova] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d2a1c61d-65d4-430f-9f1c-9311a90fc192 req-4e78123a-94bf-419d-83ca-3878d958cc14 service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-d2a1c61d-65d4-430f-9f1c-9311a90fc192 req-4e78123a-94bf-419d-83ca-3878d958cc14 service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG nova.compute.manager [req-d2a1c61d-65d4-430f-9f1c-9311a90fc192 req-4e78123a-94bf-419d-83ca-3878d958cc14 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] No waiting events found dispatching network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:53:22 user nova-compute[73520]: WARNING nova.compute.manager [req-d2a1c61d-65d4-430f-9f1c-9311a90fc192 req-4e78123a-94bf-419d-83ca-3878d958cc14 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received unexpected event network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e for instance with vm_state active and task_state reboot_started_hard.
Aug 16 12:53:22 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YkUMqVOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23835366665663736', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835366665663736', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2137004591',display_name='tempest-TestMinimumBasicScenario-server-2137004591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2137004591',id=51,image_ref='5663b9a9-85d1-43e7-ba6e-206a76918a45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlnGVuvbH0vR5Es4TjK0/O6qIVS+YKvYBBqvpzJSEIkREmcSWgLO+Qp8B/hcBxNcJztloIz5EkO4XaP8EG+w0ZzLECnvfV1f5O4NWFazUmqp3lu4gtwl5NdhvywV6NrSQ==',key_name='tempest-TestMinimumBasicScenario-274639821',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:51:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a44a0eef8e904053aec96049461d1002',ramdisk_id='',reservation_id='r-094najxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5663b9a9-85d1-43e7-ba6e-206a76918a45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-847669298',owner_user_name='tempest-TestMinimumBasicScenario-847669298-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:53:20Z,user_data=None,user_id='9f1af5415b9c4b0482e5de17486f35bc',uuid=8b59377e-6ff4-444b-8860-ea883a5a5f2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converting VIF {"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:53:22 user nova-compute[73520]:   <uuid>8b59377e-6ff4-444b-8860-ea883a5a5f2f</uuid>
Aug 16 12:53:22 user nova-compute[73520]:   <name>instance-00000033</name>
Aug 16 12:53:22 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:53:22 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:53:22 user nova-compute[73520]:   <metadata>
Aug 16 12:53:22 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:53:22 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:53:22 user nova-compute[73520]:       <nova:name>tempest-TestMinimumBasicScenario-server-2137004591</nova:name>
Aug 16 12:53:22 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:53:21</nova:creationTime>
Aug 16 12:53:22 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:53:22 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:53:22 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:53:22 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:53:22 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:53:22 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:53:22 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:53:22 user nova-compute[73520]:       <nova:owner>
Aug 16 12:53:22 user nova-compute[73520]:         <nova:user uuid="9f1af5415b9c4b0482e5de17486f35bc">tempest-TestMinimumBasicScenario-847669298-project-member</nova:user>
Aug 16 12:53:22 user nova-compute[73520]:         <nova:project uuid="a44a0eef8e904053aec96049461d1002">tempest-TestMinimumBasicScenario-847669298</nova:project>
Aug 16 12:53:22 user nova-compute[73520]:       </nova:owner>
Aug 16 12:53:22 user nova-compute[73520]:       <nova:root type="image" uuid="5663b9a9-85d1-43e7-ba6e-206a76918a45"/>
Aug 16 12:53:22 user nova-compute[73520]:       <nova:ports>
Aug 16 12:53:22 user nova-compute[73520]:         <nova:port uuid="f835a02c-1d68-4de6-9905-0e0b3463f15e">
Aug 16 12:53:22 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 12:53:22 user nova-compute[73520]:         </nova:port>
Aug 16 12:53:22 user nova-compute[73520]:       </nova:ports>
Aug 16 12:53:22 user nova-compute[73520]:     </nova:instance>
Aug 16 12:53:22 user nova-compute[73520]:   </metadata>
Aug 16 12:53:22 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:53:22 user nova-compute[73520]:     <system>
Aug 16 12:53:22 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:53:22 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:53:22 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:53:22 user nova-compute[73520]:       <entry name="serial">8b59377e-6ff4-444b-8860-ea883a5a5f2f</entry>
Aug 16 12:53:22 user nova-compute[73520]:       <entry name="uuid">8b59377e-6ff4-444b-8860-ea883a5a5f2f</entry>
Aug 16 12:53:22 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:53:22 user nova-compute[73520]:     </system>
Aug 16 12:53:22 user nova-compute[73520]:   </sysinfo>
Aug 16 12:53:22 user nova-compute[73520]:   <os>
Aug 16 12:53:22 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:53:22 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:53:22 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:53:22 user nova-compute[73520]:   </os>
Aug 16 12:53:22 user nova-compute[73520]:   <features>
Aug 16 12:53:22 user nova-compute[73520]:     <acpi/>
Aug 16 12:53:22 user nova-compute[73520]:     <apic/>
Aug 16 12:53:22 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:53:22 user nova-compute[73520]:   </features>
Aug 16 12:53:22 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:53:22 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:53:22 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:53:22 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:53:22 user nova-compute[73520]:   </clock>
Aug 16 12:53:22 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:53:22 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:53:22 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:53:22 user nova-compute[73520]:   </cpu>
Aug 16 12:53:22 user nova-compute[73520]:   <devices>
Aug 16 12:53:22 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:53:22 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:53:22 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk"/>
Aug 16 12:53:22 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:53:22 user nova-compute[73520]:     </disk>
Aug 16 12:53:22 user nova-compute[73520]:     <disk type="block" device="disk">
Aug 16 12:53:22 user nova-compute[73520]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:53:22 user nova-compute[73520]:       <source dev="/dev/sdb"/>
Aug 16 12:53:22 user nova-compute[73520]:       <target dev="vdb" bus="virtio"/>
Aug 16 12:53:22 user nova-compute[73520]:       <serial>d3a4d32d-d103-45ee-a3b7-19be099c0357</serial>
Aug 16 12:53:22 user nova-compute[73520]:     </disk>
Aug 16 12:53:22 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:53:22 user nova-compute[73520]:       <mac address="fa:16:3e:87:4f:c2"/>
Aug 16 12:53:22 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:53:22 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:53:22 user nova-compute[73520]:       <target dev="tapf835a02c-1d"/>
Aug 16 12:53:22 user nova-compute[73520]:     </interface>
Aug 16 12:53:22 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:53:22 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/console.log" append="off"/>
Aug 16 12:53:22 user nova-compute[73520]:     </serial>
Aug 16 12:53:22 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:53:22 user nova-compute[73520]:     <video>
Aug 16 12:53:22 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:53:22 user nova-compute[73520]:     </video>
Aug 16 12:53:22 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:53:22 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:53:22 user nova-compute[73520]:     </rng>
Aug 16 12:53:22 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:53:22 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:53:22 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:53:22 user nova-compute[73520]:     </memballoon>
Aug 16 12:53:22 user nova-compute[73520]:   </devices>
Aug 16 12:53:22 user nova-compute[73520]: </domain>
Aug 16 12:53:22 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG nova.objects.instance [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea4cc35aec40f093fe09349f1981d7f4d1f80144 --force-share --output=json" returned: 0 in 0.175s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Cannot resize image /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG nova.objects.instance [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'migration_context' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2137004591',display_name='tempest-TestMinimumBasicScenario-server-2137004591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2137004591',id=51,image_ref='5663b9a9-85d1-43e7-ba6e-206a76918a45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlnGVuvbH0vR5Es4TjK0/O6qIVS+YKvYBBqvpzJSEIkREmcSWgLO+Qp8B/hcBxNcJztloIz5EkO4XaP8EG+w0ZzLECnvfV1f5O4NWFazUmqp3lu4gtwl5NdhvywV6NrSQ==',key_name='tempest-TestMinimumBasicScenario-274639821',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:51:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a44a0eef8e904053aec96049461d1002',ramdisk_id='',reservation_id='r-094najxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5663b9a9-85d1-43e7-ba6e-206a76918a45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-847669298',owner_user_name='tempest-TestMinimumBasicScenario-847669298-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:53:20Z,user_data=None,user_id='9f1af5415b9c4b0482e5de17486f35bc',uuid=8b59377e-6ff4-444b-8860-ea883a5a5f2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converting VIF {"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG os_vif [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf835a02c-1d, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf835a02c-1d, col_values=(('external_ids', {'iface-id': 'f835a02c-1d68-4de6-9905-0e0b3463f15e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:4f:c2', 'vm-uuid': '8b59377e-6ff4-444b-8860-ea883a5a5f2f'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:53:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:23 user nova-compute[73520]: INFO os_vif [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d')
Aug 16 12:53:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:25 user nova-compute[73520]: DEBUG nova.compute.manager [req-a4abf8db-f4e7-4beb-8f9b-c1b096e3182c req-c4e16346-574c-4e1d-943d-05415c470279 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:53:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a4abf8db-f4e7-4beb-8f9b-c1b096e3182c req-c4e16346-574c-4e1d-943d-05415c470279 service nova] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:53:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a4abf8db-f4e7-4beb-8f9b-c1b096e3182c req-c4e16346-574c-4e1d-943d-05415c470279 service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:53:25 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a4abf8db-f4e7-4beb-8f9b-c1b096e3182c req-c4e16346-574c-4e1d-943d-05415c470279 service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:53:25 user nova-compute[73520]: DEBUG nova.compute.manager [req-a4abf8db-f4e7-4beb-8f9b-c1b096e3182c req-c4e16346-574c-4e1d-943d-05415c470279 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] No waiting events found dispatching network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:53:25 user nova-compute[73520]: WARNING nova.compute.manager [req-a4abf8db-f4e7-4beb-8f9b-c1b096e3182c req-c4e16346-574c-4e1d-943d-05415c470279 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received unexpected event network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e for instance with vm_state active and task_state reboot_started_hard.
Aug 16 12:53:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:26 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Removed pending event for 8b59377e-6ff4-444b-8860-ea883a5a5f2f due to event {{(pid=73520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 12:53:26 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692190406.9583824, 8b59377e-6ff4-444b-8860-ea883a5a5f2f => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:53:26 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] VM Resumed (Lifecycle Event)
Aug 16 12:53:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:53:26 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Instance rebooted successfully.
Aug 16 12:53:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:53:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:53:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:53:27 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 16 12:53:27 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692190406.9591653, 8b59377e-6ff4-444b-8860-ea883a5a5f2f => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:53:27 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] VM Started (Lifecycle Event)
Aug 16 12:53:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:53:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2479c571-540a-4fa3-ad18-8797a4457ba0 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.320s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:53:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:53:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-4e187900-be2e-4624-b814-8411dcfb8478 req-17b4ed81-340b-4962-afa3-68cdedb7dd71 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:53:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4e187900-be2e-4624-b814-8411dcfb8478 req-17b4ed81-340b-4962-afa3-68cdedb7dd71 service nova] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:53:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4e187900-be2e-4624-b814-8411dcfb8478 req-17b4ed81-340b-4962-afa3-68cdedb7dd71 service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:53:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4e187900-be2e-4624-b814-8411dcfb8478 req-17b4ed81-340b-4962-afa3-68cdedb7dd71 service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:53:27 user nova-compute[73520]: DEBUG nova.compute.manager [req-4e187900-be2e-4624-b814-8411dcfb8478 req-17b4ed81-340b-4962-afa3-68cdedb7dd71 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] No waiting events found dispatching network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:53:27 user nova-compute[73520]: WARNING nova.compute.manager [req-4e187900-be2e-4624-b814-8411dcfb8478 req-17b4ed81-340b-4962-afa3-68cdedb7dd71 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received unexpected event network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e for instance with vm_state active and task_state None.
Aug 16 12:53:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:53:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:53:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:53:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:53:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:53:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:53:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:53:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:53:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:54:00 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:54:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:54:03 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:54:03 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:54:05 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:54:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:54:07 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:54:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:54:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:54:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:54:08 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:54:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:54:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:54:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:54:08 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:54:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:54:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:54:08 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:54:08 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:54:08 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=25.184520721435547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:54:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:54:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:54:09 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 8b59377e-6ff4-444b-8860-ea883a5a5f2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:54:09 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:54:09 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:54:09 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing inventories for resource provider 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 12:54:09 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating ProviderTree inventory for provider 70dde5f5-9594-47c3-954e-598dd3089747 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 12:54:09 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 12:54:09 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing aggregate associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, aggregates: None {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 12:54:09 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing trait associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 12:54:09 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:54:09 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:54:09 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:54:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:54:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:54:15 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:54:15 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:54:15 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:54:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:54:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:54:15 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:54:15 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:54:15 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating instance_info_cache with network_info: [{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:54:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:54:16 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:54:18 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:54:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:54:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:54:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:54:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 12:54:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] There are 0 instances to clean {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 12:54:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:54:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:54:35 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:54:35 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 12:54:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:54:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:54:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:54:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:54:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:54:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:54:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:54:59 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:55:02 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:55:03 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:55:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:55:04 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:55:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:55:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:55:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:55:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:55:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:55:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:55:08 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:55:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:55:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:55:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:55:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:55:09 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:55:09 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 12:55:09 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:55:09 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:55:09 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8793MB free_disk=25.183971405029297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:55:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:55:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:55:10 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 8b59377e-6ff4-444b-8860-ea883a5a5f2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:55:10 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:55:10 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:55:10 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:55:10 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:55:10 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:55:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:55:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:55:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-a98e1d0d-ec77-423e-a2f4-b27dee5ffaa0 req-a5656b5d-527b-4389-9f67-cf6c45e0a28a service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-changed-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:55:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-a98e1d0d-ec77-423e-a2f4-b27dee5ffaa0 req-a5656b5d-527b-4389-9f67-cf6c45e0a28a service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Refreshing instance network info cache due to event network-changed-f835a02c-1d68-4de6-9905-0e0b3463f15e. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:55:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a98e1d0d-ec77-423e-a2f4-b27dee5ffaa0 req-a5656b5d-527b-4389-9f67-cf6c45e0a28a service nova] Acquiring lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:55:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a98e1d0d-ec77-423e-a2f4-b27dee5ffaa0 req-a5656b5d-527b-4389-9f67-cf6c45e0a28a service nova] Acquired lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:55:11 user nova-compute[73520]: DEBUG nova.network.neutron [req-a98e1d0d-ec77-423e-a2f4-b27dee5ffaa0 req-a5656b5d-527b-4389-9f67-cf6c45e0a28a service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Refreshing network info cache for port f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:55:12 user nova-compute[73520]: DEBUG nova.network.neutron [req-a98e1d0d-ec77-423e-a2f4-b27dee5ffaa0 req-a5656b5d-527b-4389-9f67-cf6c45e0a28a service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updated VIF entry in instance network info cache for port f835a02c-1d68-4de6-9905-0e0b3463f15e. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:55:12 user nova-compute[73520]: DEBUG nova.network.neutron [req-a98e1d0d-ec77-423e-a2f4-b27dee5ffaa0 req-a5656b5d-527b-4389-9f67-cf6c45e0a28a service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating instance_info_cache with network_info: [{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:55:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-a98e1d0d-ec77-423e-a2f4-b27dee5ffaa0 req-a5656b5d-527b-4389-9f67-cf6c45e0a28a service nova] Releasing lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:55:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:55:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:55:13 user nova-compute[73520]: INFO nova.compute.manager [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Detaching volume d3a4d32d-d103-45ee-a3b7-19be099c0357
Aug 16 12:55:13 user nova-compute[73520]: INFO nova.virt.block_device [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Attempting to driver detach volume d3a4d32d-d103-45ee-a3b7-19be099c0357 from mountpoint /dev/vdb
Aug 16 12:55:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Attempting to detach device vdb from instance 8b59377e-6ff4-444b-8860-ea883a5a5f2f from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 12:55:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:55:13 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:55:13 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:55:13 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:55:13 user nova-compute[73520]:   <serial>d3a4d32d-d103-45ee-a3b7-19be099c0357</serial>
Aug 16 12:55:13 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 12:55:13 user nova-compute[73520]: </disk>
Aug 16 12:55:13 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:55:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:55:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Successfully detached device vdb from instance 8b59377e-6ff4-444b-8860-ea883a5a5f2f from the persistent domain config.
Aug 16 12:55:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8b59377e-6ff4-444b-8860-ea883a5a5f2f from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 12:55:14 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:55:14 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:55:14 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:55:14 user nova-compute[73520]:   <serial>d3a4d32d-d103-45ee-a3b7-19be099c0357</serial>
Aug 16 12:55:14 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 12:55:14 user nova-compute[73520]: </disk>
Aug 16 12:55:14 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-1edf7f8c-eeb3-4a94-8209-212f8b5910d9 req-91d5459b-7b35-4240-bbb3-ed77804f36b6 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-changed-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-1edf7f8c-eeb3-4a94-8209-212f8b5910d9 req-91d5459b-7b35-4240-bbb3-ed77804f36b6 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Refreshing instance network info cache due to event network-changed-f835a02c-1d68-4de6-9905-0e0b3463f15e. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1edf7f8c-eeb3-4a94-8209-212f8b5910d9 req-91d5459b-7b35-4240-bbb3-ed77804f36b6 service nova] Acquiring lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1edf7f8c-eeb3-4a94-8209-212f8b5910d9 req-91d5459b-7b35-4240-bbb3-ed77804f36b6 service nova] Acquired lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-1edf7f8c-eeb3-4a94-8209-212f8b5910d9 req-91d5459b-7b35-4240-bbb3-ed77804f36b6 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Refreshing network info cache for port f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-1edf7f8c-eeb3-4a94-8209-212f8b5910d9 req-91d5459b-7b35-4240-bbb3-ed77804f36b6 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updated VIF entry in instance network info cache for port f835a02c-1d68-4de6-9905-0e0b3463f15e. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG nova.network.neutron [req-1edf7f8c-eeb3-4a94-8209-212f8b5910d9 req-91d5459b-7b35-4240-bbb3-ed77804f36b6 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating instance_info_cache with network_info: [{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1edf7f8c-eeb3-4a94-8209-212f8b5910d9 req-91d5459b-7b35-4240-bbb3-ed77804f36b6 service nova] Releasing lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692190514.4545712, 8b59377e-6ff4-444b-8860-ea883a5a5f2f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 12:55:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Successfully detached device vdb from instance 8b59377e-6ff4-444b-8860-ea883a5a5f2f from the live domain config.
Aug 16 12:55:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YkUMqVOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:55:14 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fa6d1e-d547-4ba0-a46d-b9ba2d4579af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2f7659-ea29-41c2-bb3b-024a17319a35]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 (non-flash)
Aug 16 12:55:14 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 (non-flash)
Aug 16 12:55:14 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c5ddab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b93bc5-fbfe-4f9a-badc-68db5edc6159]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[598c5035-2ea8-4d52-8476-bb72b56b44dc]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23bd7ef-4ba9-4ff5-9ed2-a790745f185d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[685a5b71-1a66-42f4-beb2-4f8b8ed9fdff]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[938ce55d-7792-4350-9093-be3b423b9069]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[802522f8-5c74-4dd7-9dfa-5362feaae92d]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260]
Aug 16 12:55:14 user nova-compute[73520]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357, portal: 172.16.0.220,3260] successful.
Aug 16 12:55:14 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a4d32d-d103-45ee-a3b7-19be099c0357 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a830fa48-3c0e-4a1f-b658-705ae4c425cf]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] <== disconnect_volume: return (263ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 12:55:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:55:15 user nova-compute[73520]: DEBUG nova.objects.instance [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'flavor' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:55:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-8fab9528-201b-4600-9eb2-70548de2cd73 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.694s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:55:17 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:55:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:55:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:55:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:55:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:55:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:55:17 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:55:17 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating instance_info_cache with network_info: [{"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:55:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-8b59377e-6ff4-444b-8860-ea883a5a5f2f" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:55:17 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:55:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:55:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:55:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:55:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:55:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:55:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:55:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:55:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:55:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:55:58 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:55:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:55:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:55:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:55:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:55:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:55:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:55:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:01 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:56:03 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:56:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:04 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:56:04 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:56:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:56:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:56:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:09 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:56:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:56:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:56:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:56:09 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:56:10 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:56:10 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:56:10 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.183120727539062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 8b59377e-6ff4-444b-8860-ea883a5a5f2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:56:10 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:56:10 user nova-compute[73520]: INFO nova.compute.manager [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Terminating instance
Aug 16 12:56:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-459976e5-932c-4041-96b5-f5931c49386f req-4ea6011f-3b0d-45c3-b583-25d21b5c809f service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-vif-unplugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-459976e5-932c-4041-96b5-f5931c49386f req-4ea6011f-3b0d-45c3-b583-25d21b5c809f service nova] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-459976e5-932c-4041-96b5-f5931c49386f req-4ea6011f-3b0d-45c3-b583-25d21b5c809f service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-459976e5-932c-4041-96b5-f5931c49386f req-4ea6011f-3b0d-45c3-b583-25d21b5c809f service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-459976e5-932c-4041-96b5-f5931c49386f req-4ea6011f-3b0d-45c3-b583-25d21b5c809f service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] No waiting events found dispatching network-vif-unplugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-459976e5-932c-4041-96b5-f5931c49386f req-4ea6011f-3b0d-45c3-b583-25d21b5c809f service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-vif-unplugged-f835a02c-1d68-4de6-9905-0e0b3463f15e for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Instance destroyed successfully.
Aug 16 12:56:11 user nova-compute[73520]: DEBUG nova.objects.instance [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'resources' on Instance uuid 8b59377e-6ff4-444b-8860-ea883a5a5f2f {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2137004591',display_name='tempest-TestMinimumBasicScenario-server-2137004591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2137004591',id=51,image_ref='5663b9a9-85d1-43e7-ba6e-206a76918a45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlnGVuvbH0vR5Es4TjK0/O6qIVS+YKvYBBqvpzJSEIkREmcSWgLO+Qp8B/hcBxNcJztloIz5EkO4XaP8EG+w0ZzLECnvfV1f5O4NWFazUmqp3lu4gtwl5NdhvywV6NrSQ==',key_name='tempest-TestMinimumBasicScenario-274639821',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:51:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a44a0eef8e904053aec96049461d1002',ramdisk_id='',reservation_id='r-094najxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5663b9a9-85d1-43e7-ba6e-206a76918a45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-847669298',owner_user_name='tempest-TestMinimumBasicScenario-847669298-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:53:27Z,user_data=None,user_id='9f1af5415b9c4b0482e5de17486f35bc',uuid=8b59377e-6ff4-444b-8860-ea883a5a5f2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converting VIF {"id": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "address": "fa:16:3e:87:4f:c2", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf835a02c-1d", "ovs_interfaceid": "f835a02c-1d68-4de6-9905-0e0b3463f15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG os_vif [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf835a02c-1d, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:56:11 user nova-compute[73520]: INFO os_vif [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:4f:c2,bridge_name='br-int',has_traffic_filtering=True,id=f835a02c-1d68-4de6-9905-0e0b3463f15e,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf835a02c-1d')
Aug 16 12:56:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Deleting instance files /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f_del
Aug 16 12:56:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Deletion of /opt/stack/data/nova/instances/8b59377e-6ff4-444b-8860-ea883a5a5f2f_del complete
Aug 16 12:56:11 user nova-compute[73520]: INFO nova.compute.manager [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 12:56:11 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 12:56:11 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 12:56:12 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:56:12 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Took 0.60 seconds to deallocate network for instance.
Aug 16 12:56:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:56:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:56:12 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:56:12 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:56:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:56:12 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Deleted allocations for instance 8b59377e-6ff4-444b-8860-ea883a5a5f2f
Aug 16 12:56:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-2693d21c-b29a-4322-9fd6-685905cd470a tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.902s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:56:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-c4fce891-1b12-4c26-aca3-a77004dcccdd req-59624502-22fa-4e27-9c82-497474c405a3 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:56:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c4fce891-1b12-4c26-aca3-a77004dcccdd req-59624502-22fa-4e27-9c82-497474c405a3 service nova] Acquiring lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:56:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c4fce891-1b12-4c26-aca3-a77004dcccdd req-59624502-22fa-4e27-9c82-497474c405a3 service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:56:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-c4fce891-1b12-4c26-aca3-a77004dcccdd req-59624502-22fa-4e27-9c82-497474c405a3 service nova] Lock "8b59377e-6ff4-444b-8860-ea883a5a5f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:56:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-c4fce891-1b12-4c26-aca3-a77004dcccdd req-59624502-22fa-4e27-9c82-497474c405a3 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] No waiting events found dispatching network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:56:13 user nova-compute[73520]: WARNING nova.compute.manager [req-c4fce891-1b12-4c26-aca3-a77004dcccdd req-59624502-22fa-4e27-9c82-497474c405a3 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received unexpected event network-vif-plugged-f835a02c-1d68-4de6-9905-0e0b3463f15e for instance with vm_state deleted and task_state None.
Aug 16 12:56:13 user nova-compute[73520]: DEBUG nova.compute.manager [req-c4fce891-1b12-4c26-aca3-a77004dcccdd req-59624502-22fa-4e27-9c82-497474c405a3 service nova] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Received event network-vif-deleted-f835a02c-1d68-4de6-9905-0e0b3463f15e {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:56:16 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:18 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:56:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:56:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:56:18 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 12:56:21 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:56:26 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692190571.745815, 8b59377e-6ff4-444b-8860-ea883a5a5f2f => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:56:26 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] VM Stopped (Lifecycle Event)
Aug 16 12:56:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-40970398-e388-4074-a92c-4b85209af00d None None] [instance: 8b59377e-6ff4-444b-8860-ea883a5a5f2f] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:56:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:56:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:56:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:56:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:56:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:56:36 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:56:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:56:46 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:56:51 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:56:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:56:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:56:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:56:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:56:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:56:56 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:00 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:57:00 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:57:01 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:03 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 12:57:05 user nova-compute[73520]: INFO nova.compute.claims [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Claim successful on node user
Aug 16 12:57:05 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.190s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 12:57:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 12:57:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG nova.policy [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f1af5415b9c4b0482e5de17486f35bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a44a0eef8e904053aec96049461d1002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 12:57:05 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Creating image(s)
Aug 16 12:57:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "/opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "/opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "/opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "5b99b8a8fed88e70f780396883eb7b5984d86b31" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:57:05 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "5b99b8a8fed88e70f780396883eb7b5984d86b31" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31.part --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Successfully created port: c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31.part --force-share --output=json" returned: 0 in 0.203s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG nova.virt.images [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] bc7732e6-1532-4898-9dba-2615b733de5d was qcow2, converting to raw {{(pid=73520) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG nova.privsep.utils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73520) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31.part /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31.converted {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31.part /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31.converted" returned: 0 in 0.410s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31.converted --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31.converted --force-share --output=json" returned: 0 in 0.252s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "5b99b8a8fed88e70f780396883eb7b5984d86b31" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.416s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:57:06 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31 --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "5b99b8a8fed88e70f780396883eb7b5984d86b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "5b99b8a8fed88e70f780396883eb7b5984d86b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31 --force-share --output=json" returned: 0 in 0.199s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31,backing_fmt=raw /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31,backing_fmt=raw /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk 1073741824" returned: 0 in 0.054s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "5b99b8a8fed88e70f780396883eb7b5984d86b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Successfully updated port: c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquired lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-dc963798-afd6-402f-a3a8-cae3b9562e07 req-0867332d-c221-4e48-ab62-d7a452f5c837 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-changed-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.compute.manager [req-dc963798-afd6-402f-a3a8-cae3b9562e07 req-0867332d-c221-4e48-ab62-d7a452f5c837 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Refreshing instance network info cache due to event network-changed-c02cf487-efb0-483f-a7c6-12b01a15d063. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-dc963798-afd6-402f-a3a8-cae3b9562e07 req-0867332d-c221-4e48-ab62-d7a452f5c837 service nova] Acquiring lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b99b8a8fed88e70f780396883eb7b5984d86b31 --force-share --output=json" returned: 0 in 0.181s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Cannot resize image /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.objects.instance [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'migration_context' on Instance uuid 44f57c46-696d-4a91-b131-8dd7432beea8 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Ensure instance console log exists: /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.network.neutron [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating instance_info_cache with network_info: [{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Releasing lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Instance network_info: |[{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-dc963798-afd6-402f-a3a8-cae3b9562e07 req-0867332d-c221-4e48-ab62-d7a452f5c837 service nova] Acquired lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.network.neutron [req-dc963798-afd6-402f-a3a8-cae3b9562e07 req-0867332d-c221-4e48-ab62-d7a452f5c837 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Refreshing network info cache for port c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Start _get_guest_xml network_info=[{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:57:02Z,direct_url=<?>,disk_format='qcow2',id=bc7732e6-1532-4898-9dba-2615b733de5d,min_disk=0,min_ram=0,name='tempest-scenario-img--112415813',owner='a44a0eef8e904053aec96049461d1002',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:57:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'bc7732e6-1532-4898-9dba-2615b733de5d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 12:57:07 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:57:07 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:57:02Z,direct_url=<?>,disk_format='qcow2',id=bc7732e6-1532-4898-9dba-2615b733de5d,min_disk=0,min_ram=0,name='tempest-scenario-img--112415813',owner='a44a0eef8e904053aec96049461d1002',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:57:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1042168777',display_name='tempest-TestMinimumBasicScenario-server-1042168777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1042168777',id=52,image_ref='bc7732e6-1532-4898-9dba-2615b733de5d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHrqsWIEDWJ7RKdE11FIHZtJTz8vFu5lpkWmXNegdGnnXcUsghtqLZhVhtSYLPF4/MXyX2ERSCaz/Ax+GStnn6/noTUqgbaou+wXK2dgCa4mCB18AiAbE3LJGHQnwi7yA==',key_name='tempest-TestMinimumBasicScenario-597030630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a44a0eef8e904053aec96049461d1002',ramdisk_id='',reservation_id='r-l2e0x1rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc7732e6-1532-4898-9dba-2615b733de5d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-847669298',owner_user_name='tempest-TestMinimumBasicScenario-847669298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:57:05Z,user_data=None,user_id='9f1af5415b9c4b0482e5de17486f35bc',uuid=44f57c46-696d-4a91-b131-8dd7432beea8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converting VIF {"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:23:06,bridge_name='br-int',has_traffic_filtering=True,id=c02cf487-efb0-483f-a7c6-12b01a15d063,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02cf487-ef') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:57:07 user nova-compute[73520]: DEBUG nova.objects.instance [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'pci_devices' on Instance uuid 44f57c46-696d-4a91-b131-8dd7432beea8 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] End _get_guest_xml xml=<domain type="kvm">
Aug 16 12:57:08 user nova-compute[73520]:   <uuid>44f57c46-696d-4a91-b131-8dd7432beea8</uuid>
Aug 16 12:57:08 user nova-compute[73520]:   <name>instance-00000034</name>
Aug 16 12:57:08 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 12:57:08 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 12:57:08 user nova-compute[73520]:   <metadata>
Aug 16 12:57:08 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 12:57:08 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 12:57:08 user nova-compute[73520]:       <nova:name>tempest-TestMinimumBasicScenario-server-1042168777</nova:name>
Aug 16 12:57:08 user nova-compute[73520]:       <nova:creationTime>2023-08-16 12:57:07</nova:creationTime>
Aug 16 12:57:08 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 12:57:08 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 12:57:08 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 12:57:08 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 12:57:08 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 12:57:08 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 12:57:08 user nova-compute[73520]:       </nova:flavor>
Aug 16 12:57:08 user nova-compute[73520]:       <nova:owner>
Aug 16 12:57:08 user nova-compute[73520]:         <nova:user uuid="9f1af5415b9c4b0482e5de17486f35bc">tempest-TestMinimumBasicScenario-847669298-project-member</nova:user>
Aug 16 12:57:08 user nova-compute[73520]:         <nova:project uuid="a44a0eef8e904053aec96049461d1002">tempest-TestMinimumBasicScenario-847669298</nova:project>
Aug 16 12:57:08 user nova-compute[73520]:       </nova:owner>
Aug 16 12:57:08 user nova-compute[73520]:       <nova:root type="image" uuid="bc7732e6-1532-4898-9dba-2615b733de5d"/>
Aug 16 12:57:08 user nova-compute[73520]:       <nova:ports>
Aug 16 12:57:08 user nova-compute[73520]:         <nova:port uuid="c02cf487-efb0-483f-a7c6-12b01a15d063">
Aug 16 12:57:08 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 12:57:08 user nova-compute[73520]:         </nova:port>
Aug 16 12:57:08 user nova-compute[73520]:       </nova:ports>
Aug 16 12:57:08 user nova-compute[73520]:     </nova:instance>
Aug 16 12:57:08 user nova-compute[73520]:   </metadata>
Aug 16 12:57:08 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 12:57:08 user nova-compute[73520]:     <system>
Aug 16 12:57:08 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 12:57:08 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 12:57:08 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 12:57:08 user nova-compute[73520]:       <entry name="serial">44f57c46-696d-4a91-b131-8dd7432beea8</entry>
Aug 16 12:57:08 user nova-compute[73520]:       <entry name="uuid">44f57c46-696d-4a91-b131-8dd7432beea8</entry>
Aug 16 12:57:08 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 12:57:08 user nova-compute[73520]:     </system>
Aug 16 12:57:08 user nova-compute[73520]:   </sysinfo>
Aug 16 12:57:08 user nova-compute[73520]:   <os>
Aug 16 12:57:08 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 12:57:08 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 12:57:08 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 12:57:08 user nova-compute[73520]:   </os>
Aug 16 12:57:08 user nova-compute[73520]:   <features>
Aug 16 12:57:08 user nova-compute[73520]:     <acpi/>
Aug 16 12:57:08 user nova-compute[73520]:     <apic/>
Aug 16 12:57:08 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 12:57:08 user nova-compute[73520]:   </features>
Aug 16 12:57:08 user nova-compute[73520]:   <clock offset="utc">
Aug 16 12:57:08 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 12:57:08 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 12:57:08 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 12:57:08 user nova-compute[73520]:   </clock>
Aug 16 12:57:08 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 12:57:08 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 12:57:08 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 12:57:08 user nova-compute[73520]:   </cpu>
Aug 16 12:57:08 user nova-compute[73520]:   <devices>
Aug 16 12:57:08 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 12:57:08 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 12:57:08 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk"/>
Aug 16 12:57:08 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 12:57:08 user nova-compute[73520]:     </disk>
Aug 16 12:57:08 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 12:57:08 user nova-compute[73520]:       <mac address="fa:16:3e:4c:23:06"/>
Aug 16 12:57:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:57:08 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 12:57:08 user nova-compute[73520]:       <target dev="tapc02cf487-ef"/>
Aug 16 12:57:08 user nova-compute[73520]:     </interface>
Aug 16 12:57:08 user nova-compute[73520]:     <serial type="pty">
Aug 16 12:57:08 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/console.log" append="off"/>
Aug 16 12:57:08 user nova-compute[73520]:     </serial>
Aug 16 12:57:08 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 12:57:08 user nova-compute[73520]:     <video>
Aug 16 12:57:08 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 12:57:08 user nova-compute[73520]:     </video>
Aug 16 12:57:08 user nova-compute[73520]:     <rng model="virtio">
Aug 16 12:57:08 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 12:57:08 user nova-compute[73520]:     </rng>
Aug 16 12:57:08 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 12:57:08 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 12:57:08 user nova-compute[73520]:       <stats period="10"/>
Aug 16 12:57:08 user nova-compute[73520]:     </memballoon>
Aug 16 12:57:08 user nova-compute[73520]:   </devices>
Aug 16 12:57:08 user nova-compute[73520]: </domain>
Aug 16 12:57:08 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1042168777',display_name='tempest-TestMinimumBasicScenario-server-1042168777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1042168777',id=52,image_ref='bc7732e6-1532-4898-9dba-2615b733de5d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHrqsWIEDWJ7RKdE11FIHZtJTz8vFu5lpkWmXNegdGnnXcUsghtqLZhVhtSYLPF4/MXyX2ERSCaz/Ax+GStnn6/noTUqgbaou+wXK2dgCa4mCB18AiAbE3LJGHQnwi7yA==',key_name='tempest-TestMinimumBasicScenario-597030630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a44a0eef8e904053aec96049461d1002',ramdisk_id='',reservation_id='r-l2e0x1rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc7732e6-1532-4898-9dba-2615b733de5d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-847669298',owner_user_name='tempest-TestMinimumBasicScenario-847669298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T12:57:05Z,user_data=None,user_id='9f1af5415b9c4b0482e5de17486f35bc',uuid=44f57c46-696d-4a91-b131-8dd7432beea8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converting VIF {"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:23:06,bridge_name='br-int',has_traffic_filtering=True,id=c02cf487-efb0-483f-a7c6-12b01a15d063,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02cf487-ef') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG os_vif [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:23:06,bridge_name='br-int',has_traffic_filtering=True,id=c02cf487-efb0-483f-a7c6-12b01a15d063,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02cf487-ef') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc02cf487-ef, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc02cf487-ef, col_values=(('external_ids', {'iface-id': 'c02cf487-efb0-483f-a7c6-12b01a15d063', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:23:06', 'vm-uuid': '44f57c46-696d-4a91-b131-8dd7432beea8'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:08 user nova-compute[73520]: INFO os_vif [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:23:06,bridge_name='br-int',has_traffic_filtering=True,id=c02cf487-efb0-483f-a7c6-12b01a15d063,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02cf487-ef')
Aug 16 12:57:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] No VIF found with MAC fa:16:3e:4c:23:06, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG nova.network.neutron [req-dc963798-afd6-402f-a3a8-cae3b9562e07 req-0867332d-c221-4e48-ab62-d7a452f5c837 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updated VIF entry in instance network info cache for port c02cf487-efb0-483f-a7c6-12b01a15d063. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG nova.network.neutron [req-dc963798-afd6-402f-a3a8-cae3b9562e07 req-0867332d-c221-4e48-ab62-d7a452f5c837 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating instance_info_cache with network_info: [{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:57:08 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-dc963798-afd6-402f-a3a8-cae3b9562e07 req-0867332d-c221-4e48-ab62-d7a452f5c837 service nova] Releasing lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:57:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-2225ee3a-61d4-4023-96b6-08425d49bb62 req-9b03486d-e302-4c99-b788-e13f72fc576b service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:57:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2225ee3a-61d4-4023-96b6-08425d49bb62 req-9b03486d-e302-4c99-b788-e13f72fc576b service nova] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:57:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2225ee3a-61d4-4023-96b6-08425d49bb62 req-9b03486d-e302-4c99-b788-e13f72fc576b service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:57:09 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2225ee3a-61d4-4023-96b6-08425d49bb62 req-9b03486d-e302-4c99-b788-e13f72fc576b service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:57:09 user nova-compute[73520]: DEBUG nova.compute.manager [req-2225ee3a-61d4-4023-96b6-08425d49bb62 req-9b03486d-e302-4c99-b788-e13f72fc576b service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] No waiting events found dispatching network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:57:09 user nova-compute[73520]: WARNING nova.compute.manager [req-2225ee3a-61d4-4023-96b6-08425d49bb62 req-9b03486d-e302-4c99-b788-e13f72fc576b service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received unexpected event network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 for instance with vm_state building and task_state spawning.
Aug 16 12:57:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:09 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:57:09 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692190631.3573086, 44f57c46-696d-4a91-b131-8dd7432beea8 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:57:11 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] VM Resumed (Lifecycle Event)
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 12:57:11 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Instance spawned successfully.
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 12:57:11 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692190631.3580856, 44f57c46-696d-4a91-b131-8dd7432beea8 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:57:11 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] VM Started (Lifecycle Event)
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:57:11 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 12:57:11 user nova-compute[73520]: INFO nova.compute.manager [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:57:11 user nova-compute[73520]: INFO nova.compute.manager [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Took 6.47 seconds to build instance.
Aug 16 12:57:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-6278c0bb-aeec-4c86-a150-8b6749df951c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.560s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-37f44d99-e4a9-44ac-8f32-1357251e1879 req-400e2b45-22d8-4db8-9da4-13ab5a3681fa service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-37f44d99-e4a9-44ac-8f32-1357251e1879 req-400e2b45-22d8-4db8-9da4-13ab5a3681fa service nova] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-37f44d99-e4a9-44ac-8f32-1357251e1879 req-400e2b45-22d8-4db8-9da4-13ab5a3681fa service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-37f44d99-e4a9-44ac-8f32-1357251e1879 req-400e2b45-22d8-4db8-9da4-13ab5a3681fa service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.compute.manager [req-37f44d99-e4a9-44ac-8f32-1357251e1879 req-400e2b45-22d8-4db8-9da4-13ab5a3681fa service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] No waiting events found dispatching network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:57:11 user nova-compute[73520]: WARNING nova.compute.manager [req-37f44d99-e4a9-44ac-8f32-1357251e1879 req-400e2b45-22d8-4db8-9da4-13ab5a3681fa service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received unexpected event network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 for instance with vm_state active and task_state None.
Aug 16 12:57:11 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:57:11 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:57:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:57:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:57:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:57:12 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:57:12 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:57:12 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:57:12 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8869MB free_disk=25.180648803710938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:57:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:57:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:57:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:13 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 44f57c46-696d-4a91-b131-8dd7432beea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:57:13 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:57:13 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:57:13 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:57:13 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:57:13 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:57:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:57:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:57:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:57:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:57:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:57:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:57:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:57:20 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 44f57c46-696d-4a91-b131-8dd7432beea8 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:57:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating instance_info_cache with network_info: [{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:57:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:57:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:57:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:57:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:57:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:57:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:57:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:57:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:57:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:57:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:57:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:58:02 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:58:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:58:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:58:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:58:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:58:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:58:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:58:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:58:03 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:58:05 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:58:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:58:07 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:58:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:58:11 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:58:11 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:58:12 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:58:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:58:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:58:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:58:12 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:58:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:58:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:58:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:58:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:58:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:58:13 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:58:13 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:58:13 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=25.15222930908203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:58:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:58:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:58:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 44f57c46-696d-4a91-b131-8dd7432beea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:58:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:58:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:58:14 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:58:14 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:58:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:58:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:58:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:58:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:58:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:58:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:58:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:58:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:58:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:58:20 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 44f57c46-696d-4a91-b131-8dd7432beea8 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:58:20 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating instance_info_cache with network_info: [{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:58:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:58:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:58:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:58:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:58:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:58:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:58:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:58:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:58:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:58:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:58:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:58:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:58:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:58:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:58:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:58:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:58:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:58:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:58:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:58:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:58:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:58:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:58:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:58:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:58:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG nova.objects.instance [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'flavor' on Instance uuid 44f57c46-696d-4a91-b131-8dd7432beea8 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:58:59 user nova-compute[73520]: INFO nova.compute.manager [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Attaching volume b26b4709-ddf0-4dbb-991b-d87a205be237 to /dev/vdb
Aug 16 12:58:59 user nova-compute[73520]: DEBUG os_brick.utils [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa3aac8-4493-4d82-bb15-6d90a13851b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[67865986-dd64-4abf-b78b-0ff09206f27d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d32cff-ff2c-4edc-9910-ea562fabc4f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[63807290-dc2f-4eb9-879d-496a2c13782b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 12:58:59 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 12:58:59 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c6e6cd-2b5d-4548-a198-5bccd1a033b0]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG os_brick.utils [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:58:59 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating existing volume attachment record: 53688240-f799-4404-bf8d-5085dd8dd539 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 12:59:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:59:04 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 12:59:05 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:07 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:59:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 12:59:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:59:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 12:59:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:11 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:12 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:59:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:59:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:59:12 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 12:59:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:59:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:59:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:59:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:59:14 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:59:14 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 12:59:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=25.151458740234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 44f57c46-696d-4a91-b131-8dd7432beea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing inventories for resource provider 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating ProviderTree inventory for provider 70dde5f5-9594-47c3-954e-598dd3089747 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing aggregate associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, aggregates: None {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing trait associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 12:59:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:59:15 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKBAqCLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 12:59:16 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:59:16 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 12:59:16 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead6cf03-617e-4d3f-87e1-ae060600db56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 12:59:16 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f370b9ff-3991-477e-a1d9-2b90a4ed77bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237] added
Aug 16 12:59:16 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8412d9e-4e7d-42c1-a73c-68593ab32665]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bfaee7-ce5a-4821-90aa-53e262b3ebc5]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKBAqCLg {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKBAqCLg" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d04bd6b-b220-464b-bc7f-a684b71d33b5]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zKBAqCLg'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd36ade-6af0-4ccd-8833-5e264ce0935b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[df485510-9248-4474-b66d-0bf4571e294e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:59:16 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 12:59:16 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:59:16 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 12:59:16 user nova-compute[73520]: 
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[afee510e-a6a4-4d10-892e-e660948cca48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237, portal: 172.16.0.220,3260]
Aug 16 12:59:16 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237, portal: 172.16.0.220,3260] successful.
Aug 16 12:59:16 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abcec6a-7434-40da-904b-db70a31c83fb]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63e448a-3d2f-4ec2-8a6a-ea15917c2b0a]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 (non-flash)
Aug 16 12:59:16 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 (non-flash)
Aug 16 12:59:16 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3c75f1-bf19-4b09-b49e-964339d1c67d]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 12:59:16 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKBAqCLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 12:59:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 12:59:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23864363831353930', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 12:59:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864363831353930', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 12:59:17 user nova-compute[73520]: DEBUG nova.objects.instance [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'flavor' on Instance uuid 44f57c46-696d-4a91-b131-8dd7432beea8 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:59:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 12:59:17 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 12:59:17 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 12:59:17 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 12:59:17 user nova-compute[73520]:   <serial>b26b4709-ddf0-4dbb-991b-d87a205be237</serial>
Aug 16 12:59:17 user nova-compute[73520]: </disk>
Aug 16 12:59:17 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 12:59:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:59:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 12:59:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] No VIF found with MAC fa:16:3e:4c:23:06, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 12:59:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-17c73e2c-51bf-4f73-8d6a-68282c456350 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.221s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:59:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 12:59:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 12:59:20 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 12:59:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:59:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:59:21 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 12:59:21 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 44f57c46-696d-4a91-b131-8dd7432beea8 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 12:59:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-523f9d72-7a54-4d6d-b26b-f21f933e228b req-dfbe2fea-62fd-424a-b720-c3b776fd0c00 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-changed-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:59:21 user nova-compute[73520]: DEBUG nova.compute.manager [req-523f9d72-7a54-4d6d-b26b-f21f933e228b req-dfbe2fea-62fd-424a-b720-c3b776fd0c00 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Refreshing instance network info cache due to event network-changed-c02cf487-efb0-483f-a7c6-12b01a15d063. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:59:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-523f9d72-7a54-4d6d-b26b-f21f933e228b req-dfbe2fea-62fd-424a-b720-c3b776fd0c00 service nova] Acquiring lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:59:21 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating instance_info_cache with network_info: [{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:59:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:59:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 12:59:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-523f9d72-7a54-4d6d-b26b-f21f933e228b req-dfbe2fea-62fd-424a-b720-c3b776fd0c00 service nova] Acquired lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:59:21 user nova-compute[73520]: DEBUG nova.network.neutron [req-523f9d72-7a54-4d6d-b26b-f21f933e228b req-dfbe2fea-62fd-424a-b720-c3b776fd0c00 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Refreshing network info cache for port c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:59:22 user nova-compute[73520]: DEBUG nova.network.neutron [req-523f9d72-7a54-4d6d-b26b-f21f933e228b req-dfbe2fea-62fd-424a-b720-c3b776fd0c00 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updated VIF entry in instance network info cache for port c02cf487-efb0-483f-a7c6-12b01a15d063. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:59:22 user nova-compute[73520]: DEBUG nova.network.neutron [req-523f9d72-7a54-4d6d-b26b-f21f933e228b req-dfbe2fea-62fd-424a-b720-c3b776fd0c00 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating instance_info_cache with network_info: [{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:59:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-523f9d72-7a54-4d6d-b26b-f21f933e228b req-dfbe2fea-62fd-424a-b720-c3b776fd0c00 service nova] Releasing lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG nova.compute.manager [req-2967a8ce-2c87-4ab8-90b2-d83d8b79da78 req-99c93292-7580-46af-a770-55205c69c275 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-changed-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG nova.compute.manager [req-2967a8ce-2c87-4ab8-90b2-d83d8b79da78 req-99c93292-7580-46af-a770-55205c69c275 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Refreshing instance network info cache due to event network-changed-c02cf487-efb0-483f-a7c6-12b01a15d063. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2967a8ce-2c87-4ab8-90b2-d83d8b79da78 req-99c93292-7580-46af-a770-55205c69c275 service nova] Acquiring lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2967a8ce-2c87-4ab8-90b2-d83d8b79da78 req-99c93292-7580-46af-a770-55205c69c275 service nova] Acquired lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG nova.network.neutron [req-2967a8ce-2c87-4ab8-90b2-d83d8b79da78 req-99c93292-7580-46af-a770-55205c69c275 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Refreshing network info cache for port c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc1b120b-b226-4675-b1b1-f341aace6f3c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc1b120b-b226-4675-b1b1-f341aace6f3c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:59:23 user nova-compute[73520]: INFO nova.compute.manager [None req-dc1b120b-b226-4675-b1b1-f341aace6f3c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Rebooting instance
Aug 16 12:59:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc1b120b-b226-4675-b1b1-f341aace6f3c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG nova.network.neutron [req-2967a8ce-2c87-4ab8-90b2-d83d8b79da78 req-99c93292-7580-46af-a770-55205c69c275 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updated VIF entry in instance network info cache for port c02cf487-efb0-483f-a7c6-12b01a15d063. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG nova.network.neutron [req-2967a8ce-2c87-4ab8-90b2-d83d8b79da78 req-99c93292-7580-46af-a770-55205c69c275 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating instance_info_cache with network_info: [{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-2967a8ce-2c87-4ab8-90b2-d83d8b79da78 req-99c93292-7580-46af-a770-55205c69c275 service nova] Releasing lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc1b120b-b226-4675-b1b1-f341aace6f3c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquired lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dc1b120b-b226-4675-b1b1-f341aace6f3c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 12:59:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:24 user nova-compute[73520]: DEBUG nova.network.neutron [None req-dc1b120b-b226-4675-b1b1-f341aace6f3c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating instance_info_cache with network_info: [{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 12:59:24 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc1b120b-b226-4675-b1b1-f341aace6f3c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Releasing lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 12:59:24 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dc1b120b-b226-4675-b1b1-f341aace6f3c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:59:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:26 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:26 user nova-compute[73520]: DEBUG nova.compute.manager [req-187cc266-49f6-4f86-b5b1-77c097dba2b6 req-26478c6a-5c98-4d8b-bdf4-de618c9d72ae service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-vif-unplugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:59:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-187cc266-49f6-4f86-b5b1-77c097dba2b6 req-26478c6a-5c98-4d8b-bdf4-de618c9d72ae service nova] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:59:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-187cc266-49f6-4f86-b5b1-77c097dba2b6 req-26478c6a-5c98-4d8b-bdf4-de618c9d72ae service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:59:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-187cc266-49f6-4f86-b5b1-77c097dba2b6 req-26478c6a-5c98-4d8b-bdf4-de618c9d72ae service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:59:26 user nova-compute[73520]: DEBUG nova.compute.manager [req-187cc266-49f6-4f86-b5b1-77c097dba2b6 req-26478c6a-5c98-4d8b-bdf4-de618c9d72ae service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] No waiting events found dispatching network-vif-unplugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:59:26 user nova-compute[73520]: WARNING nova.compute.manager [req-187cc266-49f6-4f86-b5b1-77c097dba2b6 req-26478c6a-5c98-4d8b-bdf4-de618c9d72ae service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received unexpected event network-vif-unplugged-c02cf487-efb0-483f-a7c6-12b01a15d063 for instance with vm_state active and task_state reboot_started.
Aug 16 12:59:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:27 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-dc1b120b-b226-4675-b1b1-f341aace6f3c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Instance shutdown successfully.
Aug 16 12:59:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:27 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-6df9404e-298c-43ee-9741-c7eff452dea2 req-3d5d2dab-7199-462c-a4f5-81ed11089c1f service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:59:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6df9404e-298c-43ee-9741-c7eff452dea2 req-3d5d2dab-7199-462c-a4f5-81ed11089c1f service nova] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:59:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6df9404e-298c-43ee-9741-c7eff452dea2 req-3d5d2dab-7199-462c-a4f5-81ed11089c1f service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:59:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-6df9404e-298c-43ee-9741-c7eff452dea2 req-3d5d2dab-7199-462c-a4f5-81ed11089c1f service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:59:28 user nova-compute[73520]: DEBUG nova.compute.manager [req-6df9404e-298c-43ee-9741-c7eff452dea2 req-3d5d2dab-7199-462c-a4f5-81ed11089c1f service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] No waiting events found dispatching network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:59:28 user nova-compute[73520]: WARNING nova.compute.manager [req-6df9404e-298c-43ee-9741-c7eff452dea2 req-3d5d2dab-7199-462c-a4f5-81ed11089c1f service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received unexpected event network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 for instance with vm_state active and task_state reboot_started.
Aug 16 12:59:28 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 12:59:28 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] There are 0 instances to clean {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 12:59:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Removed pending event for 44f57c46-696d-4a91-b131-8dd7432beea8 due to event {{(pid=73520) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692190770.7481618, 44f57c46-696d-4a91-b131-8dd7432beea8 => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:59:30 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] VM Resumed (Lifecycle Event)
Aug 16 12:59:30 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Instance running successfully.
Aug 16 12:59:30 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-dc1b120b-b226-4675-b1b1-f341aace6f3c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Instance soft rebooted successfully.
Aug 16 12:59:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-dc1b120b-b226-4675-b1b1-f341aace6f3c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-e27b14d0-ba9d-4c84-b820-be6699a2e323 req-89ec581f-8de2-44e2-a0c4-75e5b1431572 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e27b14d0-ba9d-4c84-b820-be6699a2e323 req-89ec581f-8de2-44e2-a0c4-75e5b1431572 service nova] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e27b14d0-ba9d-4c84-b820-be6699a2e323 req-89ec581f-8de2-44e2-a0c4-75e5b1431572 service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e27b14d0-ba9d-4c84-b820-be6699a2e323 req-89ec581f-8de2-44e2-a0c4-75e5b1431572 service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-e27b14d0-ba9d-4c84-b820-be6699a2e323 req-89ec581f-8de2-44e2-a0c4-75e5b1431572 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] No waiting events found dispatching network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:59:30 user nova-compute[73520]: WARNING nova.compute.manager [req-e27b14d0-ba9d-4c84-b820-be6699a2e323 req-89ec581f-8de2-44e2-a0c4-75e5b1431572 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received unexpected event network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 for instance with vm_state active and task_state reboot_started.
Aug 16 12:59:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-e27b14d0-ba9d-4c84-b820-be6699a2e323 req-89ec581f-8de2-44e2-a0c4-75e5b1431572 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e27b14d0-ba9d-4c84-b820-be6699a2e323 req-89ec581f-8de2-44e2-a0c4-75e5b1431572 service nova] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e27b14d0-ba9d-4c84-b820-be6699a2e323 req-89ec581f-8de2-44e2-a0c4-75e5b1431572 service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e27b14d0-ba9d-4c84-b820-be6699a2e323 req-89ec581f-8de2-44e2-a0c4-75e5b1431572 service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG nova.compute.manager [req-e27b14d0-ba9d-4c84-b820-be6699a2e323 req-89ec581f-8de2-44e2-a0c4-75e5b1431572 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] No waiting events found dispatching network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 12:59:30 user nova-compute[73520]: WARNING nova.compute.manager [req-e27b14d0-ba9d-4c84-b820-be6699a2e323 req-89ec581f-8de2-44e2-a0c4-75e5b1431572 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received unexpected event network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 for instance with vm_state active and task_state reboot_started.
Aug 16 12:59:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:59:30 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 16 12:59:30 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692190770.753073, 44f57c46-696d-4a91-b131-8dd7432beea8 => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 12:59:30 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] VM Started (Lifecycle Event)
Aug 16 12:59:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-dc1b120b-b226-4675-b1b1-f341aace6f3c tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.395s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:59:30 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 12:59:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:45 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:45 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 44f57c46-696d-4a91-b131-8dd7432beea8 {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 12:59:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 12:59:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 12:59:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 12:59:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 12:59:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 12:59:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 12:59:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:00:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:00:04 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:00:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 13:00:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:00:07 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:00:07 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:00:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:00:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:00:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:00:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:00:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:00:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:00:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:00:12 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:00:12 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:00:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:00:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:00:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:00:12 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 13:00:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:00:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:00:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:00:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:00:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:00:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 13:00:14 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:00:14 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:00:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.149547576904297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 13:00:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:00:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:00:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 44f57c46-696d-4a91-b131-8dd7432beea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 13:00:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 13:00:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 13:00:14 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:00:14 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:00:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 13:00:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:00:17 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:00:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:00:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:00:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 13:00:21 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 13:00:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:00:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:00:22 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 13:00:22 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 44f57c46-696d-4a91-b131-8dd7432beea8 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:00:22 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating instance_info_cache with network_info: [{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:00:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:00:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 13:00:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:00:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:00:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:00:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:00:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:00:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:00:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:00:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:00:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:00:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:00:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:00:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:00:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:00:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:00:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:00:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:00:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:00:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:00:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:00:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:00:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:00:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:00:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:01:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:01:04 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:01:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 13:01:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:01:07 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:01:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:01:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:01:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:01:12 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:01:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:01:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:01:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:01:13 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 13:01:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:01:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:01:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:01:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:01:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:01:13 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 13:01:13 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:01:13 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:01:13 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=25.149017333984375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 13:01:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:01:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:01:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 44f57c46-696d-4a91-b131-8dd7432beea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 13:01:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 13:01:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 13:01:14 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:01:14 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:01:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 13:01:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:01:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:01:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:01:15 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:01:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-da85d7bb-a719-4631-b1e6-41474780eb37 req-55f318f0-e2e8-4aca-bfd8-0067a60d7e80 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-changed-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 13:01:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-da85d7bb-a719-4631-b1e6-41474780eb37 req-55f318f0-e2e8-4aca-bfd8-0067a60d7e80 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Refreshing instance network info cache due to event network-changed-c02cf487-efb0-483f-a7c6-12b01a15d063. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 13:01:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-da85d7bb-a719-4631-b1e6-41474780eb37 req-55f318f0-e2e8-4aca-bfd8-0067a60d7e80 service nova] Acquiring lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:01:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-da85d7bb-a719-4631-b1e6-41474780eb37 req-55f318f0-e2e8-4aca-bfd8-0067a60d7e80 service nova] Acquired lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:01:15 user nova-compute[73520]: DEBUG nova.network.neutron [req-da85d7bb-a719-4631-b1e6-41474780eb37 req-55f318f0-e2e8-4aca-bfd8-0067a60d7e80 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Refreshing network info cache for port c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 13:01:15 user nova-compute[73520]: DEBUG nova.network.neutron [req-da85d7bb-a719-4631-b1e6-41474780eb37 req-55f318f0-e2e8-4aca-bfd8-0067a60d7e80 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updated VIF entry in instance network info cache for port c02cf487-efb0-483f-a7c6-12b01a15d063. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 13:01:15 user nova-compute[73520]: DEBUG nova.network.neutron [req-da85d7bb-a719-4631-b1e6-41474780eb37 req-55f318f0-e2e8-4aca-bfd8-0067a60d7e80 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating instance_info_cache with network_info: [{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:01:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-da85d7bb-a719-4631-b1e6-41474780eb37 req-55f318f0-e2e8-4aca-bfd8-0067a60d7e80 service nova] Releasing lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:01:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:01:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:01:16 user nova-compute[73520]: INFO nova.compute.manager [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Detaching volume b26b4709-ddf0-4dbb-991b-d87a205be237
Aug 16 13:01:16 user nova-compute[73520]: INFO nova.virt.block_device [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Attempting to driver detach volume b26b4709-ddf0-4dbb-991b-d87a205be237 from mountpoint /dev/vdb
Aug 16 13:01:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Attempting to detach device vdb from instance 44f57c46-696d-4a91-b131-8dd7432beea8 from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 13:01:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 13:01:16 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:01:16 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:01:16 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:01:16 user nova-compute[73520]:   <serial>b26b4709-ddf0-4dbb-991b-d87a205be237</serial>
Aug 16 13:01:16 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 13:01:16 user nova-compute[73520]: </disk>
Aug 16 13:01:16 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 13:01:16 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Successfully detached device vdb from instance 44f57c46-696d-4a91-b131-8dd7432beea8 from the persistent domain config.
Aug 16 13:01:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44f57c46-696d-4a91-b131-8dd7432beea8 from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 13:01:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 13:01:16 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:01:16 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:01:16 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:01:16 user nova-compute[73520]:   <serial>b26b4709-ddf0-4dbb-991b-d87a205be237</serial>
Aug 16 13:01:16 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 13:01:16 user nova-compute[73520]: </disk>
Aug 16 13:01:16 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692190877.0956404, 44f57c46-696d-4a91-b131-8dd7432beea8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44f57c46-696d-4a91-b131-8dd7432beea8 {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 13:01:17 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Successfully detached device vdb from instance 44f57c46-696d-4a91-b131-8dd7432beea8 from the live domain config.
Aug 16 13:01:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKBAqCLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 13:01:17 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9be8279-7c2d-453e-9841-99f2fd3d250b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d8f4ea-7bca-4d81-80e6-5e0ee4e275bd]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 (non-flash)
Aug 16 13:01:17 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 (non-flash)
Aug 16 13:01:17 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c5df6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba39814d-488c-4871-8aec-5d152ad30e4a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d6891e-4441-4f9e-b18b-9cc052364d6d]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b76f47f-dd7e-4b83-bb3d-d30372e5087b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[60495460-9fbf-453f-8dfd-4b582472f246]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1d9eb7-2b5b-467c-93ef-e84eb86dd9b5]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-095bc0c3-e63a-4d50-8894-82cae559e31a req-9db42ef7-1e26-4f97-af11-dc25da9fe238 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-changed-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG nova.compute.manager [req-095bc0c3-e63a-4d50-8894-82cae559e31a req-9db42ef7-1e26-4f97-af11-dc25da9fe238 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Refreshing instance network info cache due to event network-changed-c02cf487-efb0-483f-a7c6-12b01a15d063. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-095bc0c3-e63a-4d50-8894-82cae559e31a req-9db42ef7-1e26-4f97-af11-dc25da9fe238 service nova] Acquiring lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-095bc0c3-e63a-4d50-8894-82cae559e31a req-9db42ef7-1e26-4f97-af11-dc25da9fe238 service nova] Acquired lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG nova.network.neutron [req-095bc0c3-e63a-4d50-8894-82cae559e31a req-9db42ef7-1e26-4f97-af11-dc25da9fe238 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Refreshing network info cache for port c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2c8bcc-d8c3-4a68-96cb-3f1f890348a7]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237, portal: 172.16.0.220,3260]
Aug 16 13:01:17 user nova-compute[73520]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237, portal: 172.16.0.220,3260] successful.
Aug 16 13:01:17 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b26b4709-ddf0-4dbb-991b-d87a205be237 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce5f4c5-5a5c-4119-8966-2d9224c906b6]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.249s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] <== disconnect_volume: return (251ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 13:01:17 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:01:18 user nova-compute[73520]: DEBUG nova.network.neutron [req-095bc0c3-e63a-4d50-8894-82cae559e31a req-9db42ef7-1e26-4f97-af11-dc25da9fe238 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updated VIF entry in instance network info cache for port c02cf487-efb0-483f-a7c6-12b01a15d063. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 13:01:18 user nova-compute[73520]: DEBUG nova.network.neutron [req-095bc0c3-e63a-4d50-8894-82cae559e31a req-9db42ef7-1e26-4f97-af11-dc25da9fe238 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating instance_info_cache with network_info: [{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:01:18 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'flavor' on Instance uuid 44f57c46-696d-4a91-b131-8dd7432beea8 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:01:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-095bc0c3-e63a-4d50-8894-82cae559e31a req-9db42ef7-1e26-4f97-af11-dc25da9fe238 service nova] Releasing lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:01:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:01:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f9295907-2547-4fcb-b41e-7da4948c1399 tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.686s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:01:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:01:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 13:01:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 13:01:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:01:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:01:23 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 13:01:23 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 44f57c46-696d-4a91-b131-8dd7432beea8 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:01:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:01:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:01:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:01:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:01:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:01:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:01:23 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating instance_info_cache with network_info: [{"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:01:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-44f57c46-696d-4a91-b131-8dd7432beea8" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:01:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 13:01:24 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:01:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:01:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:01:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:01:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:01:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:01:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:01:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:01:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:01:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:01:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:01:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:01:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:01:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:01:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:01:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:01:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:01:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:01:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:01:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:01:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:01:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:01:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:02:04 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:02:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 13:02:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:02:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:02:10 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:02:10 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:02:12 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:02:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:02:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:02:12 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:02:12 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 13:02:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:02:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:02:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:02:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:02:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:02:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:02:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:02:13 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:02:13 user nova-compute[73520]: INFO nova.compute.manager [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Terminating instance
Aug 16 13:02:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 13:02:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:13 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:02:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-57a9f2e5-6cc1-4fe4-b2af-ba694d478566 req-8b23f7a4-aab4-40fa-82cb-4e143879b44e service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-vif-unplugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-57a9f2e5-6cc1-4fe4-b2af-ba694d478566 req-8b23f7a4-aab4-40fa-82cb-4e143879b44e service nova] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-57a9f2e5-6cc1-4fe4-b2af-ba694d478566 req-8b23f7a4-aab4-40fa-82cb-4e143879b44e service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-57a9f2e5-6cc1-4fe4-b2af-ba694d478566 req-8b23f7a4-aab4-40fa-82cb-4e143879b44e service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-57a9f2e5-6cc1-4fe4-b2af-ba694d478566 req-8b23f7a4-aab4-40fa-82cb-4e143879b44e service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] No waiting events found dispatching network-vif-unplugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.compute.manager [req-57a9f2e5-6cc1-4fe4-b2af-ba694d478566 req-8b23f7a4-aab4-40fa-82cb-4e143879b44e service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-vif-unplugged-c02cf487-efb0-483f-a7c6-12b01a15d063 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 13:02:14 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:02:14 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.148174285888672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:02:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Instance destroyed successfully.
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.objects.instance [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lazy-loading 'resources' on Instance uuid 44f57c46-696d-4a91-b131-8dd7432beea8 {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T12:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1042168777',display_name='tempest-TestMinimumBasicScenario-server-1042168777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1042168777',id=52,image_ref='bc7732e6-1532-4898-9dba-2615b733de5d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHrqsWIEDWJ7RKdE11FIHZtJTz8vFu5lpkWmXNegdGnnXcUsghtqLZhVhtSYLPF4/MXyX2ERSCaz/Ax+GStnn6/noTUqgbaou+wXK2dgCa4mCB18AiAbE3LJGHQnwi7yA==',key_name='tempest-TestMinimumBasicScenario-597030630',keypairs=<?>,launch_index=0,launched_at=2023-08-16T12:57:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a44a0eef8e904053aec96049461d1002',ramdisk_id='',reservation_id='r-l2e0x1rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc7732e6-1532-4898-9dba-2615b733de5d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-847669298',owner_user_name='tempest-TestMinimumBasicScenario-847669298-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T12:59:31Z,user_data=None,user_id='9f1af5415b9c4b0482e5de17486f35bc',uuid=44f57c46-696d-4a91-b131-8dd7432beea8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converting VIF {"id": "c02cf487-efb0-483f-a7c6-12b01a15d063", "address": "fa:16:3e:4c:23:06", "network": {"id": "9cf726a7-0b83-42af-a6c5-12081becba40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440181287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a0eef8e904053aec96049461d1002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02cf487-ef", "ovs_interfaceid": "c02cf487-efb0-483f-a7c6-12b01a15d063", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:23:06,bridge_name='br-int',has_traffic_filtering=True,id=c02cf487-efb0-483f-a7c6-12b01a15d063,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02cf487-ef') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG os_vif [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:23:06,bridge_name='br-int',has_traffic_filtering=True,id=c02cf487-efb0-483f-a7c6-12b01a15d063,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02cf487-ef') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc02cf487-ef, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:02:14 user nova-compute[73520]: INFO os_vif [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:23:06,bridge_name='br-int',has_traffic_filtering=True,id=c02cf487-efb0-483f-a7c6-12b01a15d063,network=Network(9cf726a7-0b83-42af-a6c5-12081becba40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02cf487-ef')
Aug 16 13:02:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Deleting instance files /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8_del
Aug 16 13:02:14 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Deletion of /opt/stack/data/nova/instances/44f57c46-696d-4a91-b131-8dd7432beea8_del complete
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 44f57c46-696d-4a91-b131-8dd7432beea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 13:02:14 user nova-compute[73520]: INFO nova.compute.manager [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 16 13:02:14 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 13:02:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:02:15 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:02:15 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Took 0.69 seconds to deallocate network for instance.
Aug 16 13:02:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:02:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:02:15 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:02:15 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:02:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-47a07a4a-0a9a-4666-b71c-51a1a2214eb4 req-2d79818d-d9cb-429a-bb46-3411ccbd6525 service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-vif-deleted-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 13:02:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:02:15 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Deleted allocations for instance 44f57c46-696d-4a91-b131-8dd7432beea8
Aug 16 13:02:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-42a20336-54ba-4d94-a96e-d2111df17f5d tempest-TestMinimumBasicScenario-847669298 tempest-TestMinimumBasicScenario-847669298-project-member] Lock "44f57c46-696d-4a91-b131-8dd7432beea8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.059s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:02:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-4cdf569e-3de1-4fd0-b18d-df58c4ea786e req-b454a31b-e91e-4645-b5a4-5755f279d9cf service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received event network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 13:02:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4cdf569e-3de1-4fd0-b18d-df58c4ea786e req-b454a31b-e91e-4645-b5a4-5755f279d9cf service nova] Acquiring lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:02:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4cdf569e-3de1-4fd0-b18d-df58c4ea786e req-b454a31b-e91e-4645-b5a4-5755f279d9cf service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:02:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-4cdf569e-3de1-4fd0-b18d-df58c4ea786e req-b454a31b-e91e-4645-b5a4-5755f279d9cf service nova] Lock "44f57c46-696d-4a91-b131-8dd7432beea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:02:15 user nova-compute[73520]: DEBUG nova.compute.manager [req-4cdf569e-3de1-4fd0-b18d-df58c4ea786e req-b454a31b-e91e-4645-b5a4-5755f279d9cf service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] No waiting events found dispatching network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 13:02:15 user nova-compute[73520]: WARNING nova.compute.manager [req-4cdf569e-3de1-4fd0-b18d-df58c4ea786e req-b454a31b-e91e-4645-b5a4-5755f279d9cf service nova] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Received unexpected event network-vif-plugged-c02cf487-efb0-483f-a7c6-12b01a15d063 for instance with vm_state deleted and task_state None.
Aug 16 13:02:17 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:02:17 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:02:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:02:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 13:02:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 13:02:22 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 13:02:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:02:29 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692190934.2913876, 44f57c46-696d-4a91-b131-8dd7432beea8 => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 13:02:29 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] VM Stopped (Lifecycle Event)
Aug 16 13:02:29 user nova-compute[73520]: DEBUG nova.compute.manager [None req-acb582fe-b5cd-4787-8162-74ca9b8c1557 None None] [instance: 44f57c46-696d-4a91-b131-8dd7432beea8] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 13:02:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:02:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:02:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:02:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:02:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:02:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:02:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:02:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:02:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:02:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:02:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:02:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:03:04 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:03:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:03:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 13:03:07 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:03:09 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:10 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:03:10 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:03:12 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:03:14 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:14 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:03:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:03:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:03:14 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:03:14 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 13:03:15 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:03:15 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:03:15 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=9078MB free_disk=25.214935302734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 13:03:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:03:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:03:15 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 13:03:15 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 13:03:15 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:03:15 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:03:15 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 13:03:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:03:18 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:03:18 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:03:19 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:03:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:03:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 13:03:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 13:03:23 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 13:03:24 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:03:28 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:03:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:03:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:03:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:03:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:03:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:03:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:39 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:44 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:47 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:49 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:54 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Starting instance... {{(pid=73520) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73520) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 13:03:55 user nova-compute[73520]: INFO nova.compute.claims [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Claim successful on node user
Aug 16 13:03:55 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Start building networks asynchronously for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Allocating IP information in the background. {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG nova.network.neutron [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] allocate_for_instance() {{(pid=73520) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 13:03:55 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 13:03:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Start building block device mappings for instance. {{(pid=73520) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG nova.policy [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b22915f2cb041ca8db38da06b786e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c32f1c3fd31467f914bcd95bb38a185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73520) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Start spawning the instance on the hypervisor. {{(pid=73520) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Creating instance directory {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 13:03:55 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Creating image(s)
Aug 16 13:03:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "/opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "/opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "/opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:03:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.172s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "dd55533720e0904ac515f90283b986b4a7612d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.189s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk 1073741824 {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61,backing_fmt=raw /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk 1073741824" returned: 0 in 0.052s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "dd55533720e0904ac515f90283b986b4a7612d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd55533720e0904ac515f90283b986b4a7612d61 --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk. size=1073741824 {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG nova.network.neutron [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Successfully created port: 6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG nova.virt.disk.api [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Cannot resize image /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk to a smaller size. {{(pid=73520) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'migration_context' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Created local disks {{(pid=73520) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Ensure instance console log exists: /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/console.log {{(pid=73520) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:03:56 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:03:57 user nova-compute[73520]: DEBUG nova.network.neutron [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Successfully updated port: 6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 13:03:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:03:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquired lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:03:57 user nova-compute[73520]: DEBUG nova.network.neutron [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Building network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 13:03:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-7bb0754e-2fda-4638-8036-c324e3c538fe req-037e3c69-3cec-49f0-8d30-51f77c9fa2e9 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Received event network-changed-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 13:03:57 user nova-compute[73520]: DEBUG nova.compute.manager [req-7bb0754e-2fda-4638-8036-c324e3c538fe req-037e3c69-3cec-49f0-8d30-51f77c9fa2e9 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Refreshing instance network info cache due to event network-changed-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 13:03:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7bb0754e-2fda-4638-8036-c324e3c538fe req-037e3c69-3cec-49f0-8d30-51f77c9fa2e9 service nova] Acquiring lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:03:57 user nova-compute[73520]: DEBUG nova.network.neutron [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Instance cache missing network info. {{(pid=73520) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.network.neutron [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating instance_info_cache with network_info: [{"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Releasing lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Instance network_info: |[{"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73520) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7bb0754e-2fda-4638-8036-c324e3c538fe req-037e3c69-3cec-49f0-8d30-51f77c9fa2e9 service nova] Acquired lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.network.neutron [req-7bb0754e-2fda-4638-8036-c324e3c538fe req-037e3c69-3cec-49f0-8d30-51f77c9fa2e9 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Refreshing network info cache for port 6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Start _get_guest_xml network_info=[{"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'image_id': 'ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 13:03:58 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:03:58 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] CPU controller missing on host. {{(pid=73520) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.host [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] CPU controller found on host. {{(pid=73520) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73520) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T12:08:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T12:08:50Z,direct_url=<?>,disk_format='qcow2',id=ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c36b9057d00349558c96f16d77c55ab2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T12:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Flavor limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Image limits 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Flavor pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Image pref 0:0:0 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Got 1 possible topologies {{(pid=73520) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.hardware [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73520) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T13:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-538797321',display_name='tempest-SnapshotDataIntegrityTests-server-538797321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-538797321',id=53,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/oB47s67mBfJ1HYtKAHNpd7eGbWYYq4+ctlyvU2eHmo8dif0Z1LkGnnBC1cJLjj+jKsDEVQTZ7qL6eOFYIUMYuEgIwv+/2ulE1dHZn0gX18rE06QX1XGxSWSwRd115ZQ==',key_name='tempest-keypair-50425724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c32f1c3fd31467f914bcd95bb38a185',ramdisk_id='',reservation_id='r-ih1jgpkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-762927158',owner_user_name='tempest-SnapshotDataIntegrityTests-762927158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T13:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b22915f2cb041ca8db38da06b786e7b',uuid=45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73520) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Converting VIF {"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7,network=Network(ea33ef5c-9a03-479c-a61f-495ecd67f7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbc9c78-d7') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.objects.instance [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'pci_devices' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 13:03:58 user nova-compute[73520]:   <uuid>45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a</uuid>
Aug 16 13:03:58 user nova-compute[73520]:   <name>instance-00000035</name>
Aug 16 13:03:58 user nova-compute[73520]:   <memory>524288</memory>
Aug 16 13:03:58 user nova-compute[73520]:   <vcpu>1</vcpu>
Aug 16 13:03:58 user nova-compute[73520]:   <metadata>
Aug 16 13:03:58 user nova-compute[73520]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 13:03:58 user nova-compute[73520]:       <nova:package version="0.0.0"/>
Aug 16 13:03:58 user nova-compute[73520]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-538797321</nova:name>
Aug 16 13:03:58 user nova-compute[73520]:       <nova:creationTime>2023-08-16 13:03:58</nova:creationTime>
Aug 16 13:03:58 user nova-compute[73520]:       <nova:flavor name="m1.tiny">
Aug 16 13:03:58 user nova-compute[73520]:         <nova:memory>512</nova:memory>
Aug 16 13:03:58 user nova-compute[73520]:         <nova:disk>1</nova:disk>
Aug 16 13:03:58 user nova-compute[73520]:         <nova:swap>0</nova:swap>
Aug 16 13:03:58 user nova-compute[73520]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 13:03:58 user nova-compute[73520]:         <nova:vcpus>1</nova:vcpus>
Aug 16 13:03:58 user nova-compute[73520]:       </nova:flavor>
Aug 16 13:03:58 user nova-compute[73520]:       <nova:owner>
Aug 16 13:03:58 user nova-compute[73520]:         <nova:user uuid="6b22915f2cb041ca8db38da06b786e7b">tempest-SnapshotDataIntegrityTests-762927158-project-member</nova:user>
Aug 16 13:03:58 user nova-compute[73520]:         <nova:project uuid="4c32f1c3fd31467f914bcd95bb38a185">tempest-SnapshotDataIntegrityTests-762927158</nova:project>
Aug 16 13:03:58 user nova-compute[73520]:       </nova:owner>
Aug 16 13:03:58 user nova-compute[73520]:       <nova:root type="image" uuid="ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe"/>
Aug 16 13:03:58 user nova-compute[73520]:       <nova:ports>
Aug 16 13:03:58 user nova-compute[73520]:         <nova:port uuid="6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7">
Aug 16 13:03:58 user nova-compute[73520]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 13:03:58 user nova-compute[73520]:         </nova:port>
Aug 16 13:03:58 user nova-compute[73520]:       </nova:ports>
Aug 16 13:03:58 user nova-compute[73520]:     </nova:instance>
Aug 16 13:03:58 user nova-compute[73520]:   </metadata>
Aug 16 13:03:58 user nova-compute[73520]:   <sysinfo type="smbios">
Aug 16 13:03:58 user nova-compute[73520]:     <system>
Aug 16 13:03:58 user nova-compute[73520]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 13:03:58 user nova-compute[73520]:       <entry name="product">OpenStack Nova</entry>
Aug 16 13:03:58 user nova-compute[73520]:       <entry name="version">0.0.0</entry>
Aug 16 13:03:58 user nova-compute[73520]:       <entry name="serial">45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a</entry>
Aug 16 13:03:58 user nova-compute[73520]:       <entry name="uuid">45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a</entry>
Aug 16 13:03:58 user nova-compute[73520]:       <entry name="family">Virtual Machine</entry>
Aug 16 13:03:58 user nova-compute[73520]:     </system>
Aug 16 13:03:58 user nova-compute[73520]:   </sysinfo>
Aug 16 13:03:58 user nova-compute[73520]:   <os>
Aug 16 13:03:58 user nova-compute[73520]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 13:03:58 user nova-compute[73520]:     <boot dev="hd"/>
Aug 16 13:03:58 user nova-compute[73520]:     <smbios mode="sysinfo"/>
Aug 16 13:03:58 user nova-compute[73520]:   </os>
Aug 16 13:03:58 user nova-compute[73520]:   <features>
Aug 16 13:03:58 user nova-compute[73520]:     <acpi/>
Aug 16 13:03:58 user nova-compute[73520]:     <apic/>
Aug 16 13:03:58 user nova-compute[73520]:     <vmcoreinfo/>
Aug 16 13:03:58 user nova-compute[73520]:   </features>
Aug 16 13:03:58 user nova-compute[73520]:   <clock offset="utc">
Aug 16 13:03:58 user nova-compute[73520]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 13:03:58 user nova-compute[73520]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 13:03:58 user nova-compute[73520]:     <timer name="hpet" present="no"/>
Aug 16 13:03:58 user nova-compute[73520]:   </clock>
Aug 16 13:03:58 user nova-compute[73520]:   <cpu mode="custom" match="exact">
Aug 16 13:03:58 user nova-compute[73520]:     <model>Nehalem</model>
Aug 16 13:03:58 user nova-compute[73520]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 13:03:58 user nova-compute[73520]:   </cpu>
Aug 16 13:03:58 user nova-compute[73520]:   <devices>
Aug 16 13:03:58 user nova-compute[73520]:     <disk type="file" device="disk">
Aug 16 13:03:58 user nova-compute[73520]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 13:03:58 user nova-compute[73520]:       <source file="/opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk"/>
Aug 16 13:03:58 user nova-compute[73520]:       <target dev="vda" bus="virtio"/>
Aug 16 13:03:58 user nova-compute[73520]:     </disk>
Aug 16 13:03:58 user nova-compute[73520]:     <interface type="ethernet">
Aug 16 13:03:58 user nova-compute[73520]:       <mac address="fa:16:3e:1c:75:46"/>
Aug 16 13:03:58 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 13:03:58 user nova-compute[73520]:       <mtu size="1442"/>
Aug 16 13:03:58 user nova-compute[73520]:       <target dev="tap6dbc9c78-d7"/>
Aug 16 13:03:58 user nova-compute[73520]:     </interface>
Aug 16 13:03:58 user nova-compute[73520]:     <serial type="pty">
Aug 16 13:03:58 user nova-compute[73520]:       <log file="/opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/console.log" append="off"/>
Aug 16 13:03:58 user nova-compute[73520]:     </serial>
Aug 16 13:03:58 user nova-compute[73520]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 13:03:58 user nova-compute[73520]:     <video>
Aug 16 13:03:58 user nova-compute[73520]:       <model type="virtio"/>
Aug 16 13:03:58 user nova-compute[73520]:     </video>
Aug 16 13:03:58 user nova-compute[73520]:     <rng model="virtio">
Aug 16 13:03:58 user nova-compute[73520]:       <backend model="random">/dev/urandom</backend>
Aug 16 13:03:58 user nova-compute[73520]:     </rng>
Aug 16 13:03:58 user nova-compute[73520]:     <controller type="usb" index="0" model="none"/>
Aug 16 13:03:58 user nova-compute[73520]:     <memballoon model="virtio">
Aug 16 13:03:58 user nova-compute[73520]:       <stats period="10"/>
Aug 16 13:03:58 user nova-compute[73520]:     </memballoon>
Aug 16 13:03:58 user nova-compute[73520]:   </devices>
Aug 16 13:03:58 user nova-compute[73520]: </domain>
Aug 16 13:03:58 user nova-compute[73520]:  {{(pid=73520) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T13:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-538797321',display_name='tempest-SnapshotDataIntegrityTests-server-538797321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-538797321',id=53,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/oB47s67mBfJ1HYtKAHNpd7eGbWYYq4+ctlyvU2eHmo8dif0Z1LkGnnBC1cJLjj+jKsDEVQTZ7qL6eOFYIUMYuEgIwv+/2ulE1dHZn0gX18rE06QX1XGxSWSwRd115ZQ==',key_name='tempest-keypair-50425724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c32f1c3fd31467f914bcd95bb38a185',ramdisk_id='',reservation_id='r-ih1jgpkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-762927158',owner_user_name='tempest-SnapshotDataIntegrityTests-762927158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T13:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b22915f2cb041ca8db38da06b786e7b',uuid=45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Converting VIF {"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7,network=Network(ea33ef5c-9a03-479c-a61f-495ecd67f7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbc9c78-d7') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG os_vif [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7,network=Network(ea33ef5c-9a03-479c-a61f-495ecd67f7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbc9c78-d7') {{(pid=73520) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6dbc9c78-d7, may_exist=True, interface_attrs={}) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6dbc9c78-d7, col_values=(('external_ids', {'iface-id': '6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:75:46', 'vm-uuid': '45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a'}),), if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:58 user nova-compute[73520]: INFO os_vif [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7,network=Network(ea33ef5c-9a03-479c-a61f-495ecd67f7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbc9c78-d7')
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No VIF found with MAC fa:16:3e:1c:75:46, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.network.neutron [req-7bb0754e-2fda-4638-8036-c324e3c538fe req-037e3c69-3cec-49f0-8d30-51f77c9fa2e9 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updated VIF entry in instance network info cache for port 6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG nova.network.neutron [req-7bb0754e-2fda-4638-8036-c324e3c538fe req-037e3c69-3cec-49f0-8d30-51f77c9fa2e9 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating instance_info_cache with network_info: [{"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:03:58 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-7bb0754e-2fda-4638-8036-c324e3c538fe req-037e3c69-3cec-49f0-8d30-51f77c9fa2e9 service nova] Releasing lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:03:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:59 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:03:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-dcfb72f1-b9dc-4c76-9ac7-3d8f42f44d88 req-0eccdd25-86a4-4e62-94e4-48f85d3a1735 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Received event network-vif-plugged-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 13:03:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-dcfb72f1-b9dc-4c76-9ac7-3d8f42f44d88 req-0eccdd25-86a4-4e62-94e4-48f85d3a1735 service nova] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:03:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-dcfb72f1-b9dc-4c76-9ac7-3d8f42f44d88 req-0eccdd25-86a4-4e62-94e4-48f85d3a1735 service nova] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:03:59 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-dcfb72f1-b9dc-4c76-9ac7-3d8f42f44d88 req-0eccdd25-86a4-4e62-94e4-48f85d3a1735 service nova] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:03:59 user nova-compute[73520]: DEBUG nova.compute.manager [req-dcfb72f1-b9dc-4c76-9ac7-3d8f42f44d88 req-0eccdd25-86a4-4e62-94e4-48f85d3a1735 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] No waiting events found dispatching network-vif-plugged-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 13:03:59 user nova-compute[73520]: WARNING nova.compute.manager [req-dcfb72f1-b9dc-4c76-9ac7-3d8f42f44d88 req-0eccdd25-86a4-4e62-94e4-48f85d3a1735 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Received unexpected event network-vif-plugged-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 for instance with vm_state building and task_state spawning.
Aug 16 13:04:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:01 user nova-compute[73520]: DEBUG nova.compute.manager [req-e1c3fa79-a5e3-4fd6-9b5a-479c1b540e29 req-7db9fdc7-f727-47e4-a5d4-f0adb5bc46d8 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Received event network-vif-plugged-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 13:04:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e1c3fa79-a5e3-4fd6-9b5a-479c1b540e29 req-7db9fdc7-f727-47e4-a5d4-f0adb5bc46d8 service nova] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:04:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e1c3fa79-a5e3-4fd6-9b5a-479c1b540e29 req-7db9fdc7-f727-47e4-a5d4-f0adb5bc46d8 service nova] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:04:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-e1c3fa79-a5e3-4fd6-9b5a-479c1b540e29 req-7db9fdc7-f727-47e4-a5d4-f0adb5bc46d8 service nova] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:04:01 user nova-compute[73520]: DEBUG nova.compute.manager [req-e1c3fa79-a5e3-4fd6-9b5a-479c1b540e29 req-7db9fdc7-f727-47e4-a5d4-f0adb5bc46d8 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] No waiting events found dispatching network-vif-plugged-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 13:04:01 user nova-compute[73520]: WARNING nova.compute.manager [req-e1c3fa79-a5e3-4fd6-9b5a-479c1b540e29 req-7db9fdc7-f727-47e4-a5d4-f0adb5bc46d8 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Received unexpected event network-vif-plugged-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 for instance with vm_state building and task_state spawning.
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692191042.0730321, 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a => Resumed> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 13:04:02 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] VM Resumed (Lifecycle Event)
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Instance event wait completed in 0 seconds for  {{(pid=73520) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Guest created on hypervisor {{(pid=73520) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 13:04:02 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Instance spawned successfully.
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 13:04:02 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.virt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Emitting event <LifecycleEvent: 1692191042.0780652, 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a => Started> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 13:04:02 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] VM Started (Lifecycle Event)
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Found default for hw_cdrom_bus of ide {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Found default for hw_disk_bus of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Found default for hw_input_bus of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Found default for hw_pointer_model of None {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Found default for hw_video_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Found default for hw_vif_model of virtio {{(pid=73520) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73520) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 13:04:02 user nova-compute[73520]: INFO nova.compute.manager [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 13:04:02 user nova-compute[73520]: INFO nova.compute.manager [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Took 6.65 seconds to spawn the instance on the hypervisor.
Aug 16 13:04:02 user nova-compute[73520]: DEBUG nova.compute.manager [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 13:04:02 user nova-compute[73520]: INFO nova.compute.manager [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Took 7.36 seconds to build instance.
Aug 16 13:04:02 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-d65f67a8-f8bb-4771-8ec9-bb1da8a84ca8 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.481s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:04:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:06 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:04:06 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 13:04:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:04:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:10 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:04:12 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:04:12 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:04:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:14 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:04:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:04:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:04:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:04:15 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 13:04:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:04:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:04:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:04:15 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:04:16 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:04:16 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:04:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8463MB free_disk=25.199935913085938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing inventories for resource provider 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating ProviderTree inventory for provider 70dde5f5-9594-47c3-954e-598dd3089747 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing aggregate associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, aggregates: None {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing trait associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 13:04:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:04:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:04:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:04:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:04:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:04:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 13:04:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 13:04:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:04:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:04:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 13:04:26 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:04:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating instance_info_cache with network_info: [{"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:04:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:04:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 13:04:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:32 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:04:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:04:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 13:04:38 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] There are 0 instances to clean {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 13:04:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:04:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:04:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:04:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:04:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:04:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:04:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:04:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:04:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:04:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:04:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:04:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:04:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:04:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:04:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:04:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:04:59 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:04:59 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 13:05:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:07 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:05:07 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 13:05:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:05:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:05:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:05:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:05:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:05:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:09 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:05:10 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:05:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:05:13 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:05:14 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:05:15 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:05:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:05:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:05:15 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:05:15 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 13:05:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:05:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:05:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:05:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:05:16 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:05:16 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:05:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8708MB free_disk=25.16912078857422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 13:05:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:05:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:05:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 13:05:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 13:05:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 13:05:17 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:05:17 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:05:17 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 13:05:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:05:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:05:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:05:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:05:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:05:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:05:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:05:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:05:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:05:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 13:05:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 13:05:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:05:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:05:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 13:05:26 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:05:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating instance_info_cache with network_info: [{"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:05:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:05:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 13:05:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:05:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:05:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:05:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:05:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:33 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:05:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:41 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-afb6ed53-a4a0-4f2c-858f-23270a97abfc req-fc1a43bb-db3f-4266-8e55-0a6025fb8fa9 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Received event network-changed-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 13:05:46 user nova-compute[73520]: DEBUG nova.compute.manager [req-afb6ed53-a4a0-4f2c-858f-23270a97abfc req-fc1a43bb-db3f-4266-8e55-0a6025fb8fa9 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Refreshing instance network info cache due to event network-changed-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7. {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 13:05:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-afb6ed53-a4a0-4f2c-858f-23270a97abfc req-fc1a43bb-db3f-4266-8e55-0a6025fb8fa9 service nova] Acquiring lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:05:46 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-afb6ed53-a4a0-4f2c-858f-23270a97abfc req-fc1a43bb-db3f-4266-8e55-0a6025fb8fa9 service nova] Acquired lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:05:46 user nova-compute[73520]: DEBUG nova.network.neutron [req-afb6ed53-a4a0-4f2c-858f-23270a97abfc req-fc1a43bb-db3f-4266-8e55-0a6025fb8fa9 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Refreshing network info cache for port 6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 13:05:47 user nova-compute[73520]: DEBUG nova.network.neutron [req-afb6ed53-a4a0-4f2c-858f-23270a97abfc req-fc1a43bb-db3f-4266-8e55-0a6025fb8fa9 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updated VIF entry in instance network info cache for port 6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7. {{(pid=73520) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 13:05:47 user nova-compute[73520]: DEBUG nova.network.neutron [req-afb6ed53-a4a0-4f2c-858f-23270a97abfc req-fc1a43bb-db3f-4266-8e55-0a6025fb8fa9 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating instance_info_cache with network_info: [{"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:05:47 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-afb6ed53-a4a0-4f2c-858f-23270a97abfc req-fc1a43bb-db3f-4266-8e55-0a6025fb8fa9 service nova] Releasing lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:05:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:05:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:05:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:05:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:05:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'flavor' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:05:52 user nova-compute[73520]: INFO nova.compute.manager [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Attaching volume c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 to /dev/vdb
Aug 16 13:05:52 user nova-compute[73520]: DEBUG os_brick.utils [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be5bdee-0132-44b0-bdbe-8b7eede37fb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[643b0a2e-42bd-48fb-a5f8-e3558c439cc8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6118992-e9b2-434e-88be-2a6691be2355]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf94f3f4-21f2-4735-94ea-af09809e124c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 13:05:52 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 13:05:52 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd576e23-0e41-498b-b8c6-09ef2355e9fc]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG os_brick.utils [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 13:05:52 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating existing volume attachment record: b8c21c8e-97b9-4671-a49b-c0f7e4582cde {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 13:05:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:05:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JTqVsUPO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 13:06:02 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 13:06:02 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 13:06:02 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[811a0da4-d814-49c3-8e68-b82d29635b06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 13:06:02 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d162f7-af8a-437a-997d-c473a385d21e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12] added
Aug 16 13:06:02 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5560c1-c8ba-4b3d-8198-01656ffea589]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.134s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2897a32b-21d0-4a09-b751-eb9ee27f90e8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JTqVsUPO {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JTqVsUPO" returned: 0 in 0.025s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a75345-5544-43e9-87c1-6af7b07b7f20]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JTqVsUPO'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fd4c7a-3f5c-4b7d-8faa-0478f01c4391]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[65064b3a-7583-4fba-b285-00d3c0e2db04]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 13:06:02 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 13:06:02 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 13:06:02 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 13:06:02 user nova-compute[73520]: 
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[086c9ca6-06d0-4ce5-a303-6ffe69877b89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12, portal: 172.16.0.220,3260]
Aug 16 13:06:02 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12, portal: 172.16.0.220,3260] successful.
Aug 16 13:06:02 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adc3edd-23af-4c7e-b823-82dad8b1f08e]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdcc385-4712-4dbe-9370-8a26693d3697]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 (non-flash)
Aug 16 13:06:02 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 (non-flash)
Aug 16 13:06:02 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cecab01-2b10-42c2-8a5a-6c9689c9c3e1]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 13:06:02 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JTqVsUPO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 13:06:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:06:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:06:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:06:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:06:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:03 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 13:06:03 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '26434626331316636', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 13:06:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434626331316636', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 13:06:03 user nova-compute[73520]: DEBUG nova.objects.instance [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'flavor' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:06:03 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 13:06:03 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:06:03 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:06:03 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:06:03 user nova-compute[73520]:   <serial>c84bb0cd-06ab-488c-9b17-6acb4a2c4d12</serial>
Aug 16 13:06:03 user nova-compute[73520]: </disk>
Aug 16 13:06:03 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 13:06:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 13:06:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 13:06:04 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No VIF found with MAC fa:16:3e:1c:75:46, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 13:06:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-9bc918b6-0ed8-44e8-b847-a187e0a05cdc tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.903s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:06:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:06:08 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 13:06:09 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:06:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:10 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:06:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:15 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:06:15 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:06:15 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73520) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 13:06:16 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:06:16 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:06:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=25.166767120361328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 13:06:16 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 13:06:17 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:06:17 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:06:17 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 13:06:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:06:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:06:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:06:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:06:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:06:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:06:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:06:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:06:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:06:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 13:06:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 13:06:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:06:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:06:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 13:06:26 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:06:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating instance_info_cache with network_info: [{"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:06:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:06:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 13:06:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:31 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:06:34 user nova-compute[73520]: INFO nova.compute.manager [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Detaching volume c84bb0cd-06ab-488c-9b17-6acb4a2c4d12
Aug 16 13:06:34 user nova-compute[73520]: INFO nova.virt.block_device [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Attempting to driver detach volume c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 from mountpoint /dev/vdb
Aug 16 13:06:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Attempting to detach device vdb from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 13:06:34 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:06:34 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:06:34 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:06:34 user nova-compute[73520]:   <serial>c84bb0cd-06ab-488c-9b17-6acb4a2c4d12</serial>
Aug 16 13:06:34 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 13:06:34 user nova-compute[73520]: </disk>
Aug 16 13:06:34 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 13:06:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Successfully detached device vdb from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the persistent domain config.
Aug 16 13:06:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 13:06:34 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:06:34 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:06:34 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:06:34 user nova-compute[73520]:   <serial>c84bb0cd-06ab-488c-9b17-6acb4a2c4d12</serial>
Aug 16 13:06:34 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 13:06:34 user nova-compute[73520]: </disk>
Aug 16 13:06:34 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692191194.6618786, 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 13:06:34 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Successfully detached device vdb from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the live domain config.
Aug 16 13:06:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JTqVsUPO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 13:06:34 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5a89b8-fd9d-4105-8ac4-c02d9f0fe613]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d2891c-47df-4277-bedb-72d3d8042d4a]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 (non-flash)
Aug 16 13:06:34 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 (non-flash)
Aug 16 13:06:34 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa76c03f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e089625d-d51f-45c0-8b7e-cedfa0b2ed4a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2430c92-1356-4819-b236-43bf5f8b28eb]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d0b752-4325-482c-95bf-7f9a2faa8e1d]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c004131-5957-4340-bf46-f993ec20b13b]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9bb4d6-43f4-491e-8373-298500f6ce0b]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed44278b-0c67-4dff-b7c7-8d2ea220e4b0]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12, portal: 172.16.0.220,3260]
Aug 16 13:06:34 user nova-compute[73520]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12, portal: 172.16.0.220,3260] successful.
Aug 16 13:06:34 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84bb0cd-06ab-488c-9b17-6acb4a2c4d12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c833519c-072a-4abd-aab5-8d0d678f4e7c]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] <== disconnect_volume: return (283ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 13:06:34 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 13:06:35 user nova-compute[73520]: DEBUG nova.objects.instance [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'flavor' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:06:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-08a7fe9f-b817-485b-a28c-7591aa155bb1 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.632s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:06:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:06:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:06:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:06:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:06:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:06:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:06:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:06:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:06:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:06:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:06:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:06:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:06:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:06:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:06:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:06:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:07:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:07:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:07:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:07:08 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 13:07:09 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:07:11 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:07:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:07:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:07:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:07:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:07:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:07:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:07:15 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:07:17 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:07:17 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:07:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:07:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:07:17 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:07:17 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 13:07:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:07:18 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:18 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:07:18 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:07:18 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8845MB free_disk=25.16567611694336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 13:07:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:07:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:07:19 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 13:07:19 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 13:07:19 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 13:07:19 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:07:19 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:07:19 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 13:07:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:07:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:07:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:07:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:07:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:07:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:07:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:07:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:07:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:07:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:07:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 13:07:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 13:07:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:07:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:07:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 13:07:26 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:07:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating instance_info_cache with network_info: [{"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:07:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:07:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 13:07:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:07:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:07:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:07:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:07:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:07:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:07:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:07:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:07:28 user nova-compute[73520]: DEBUG nova.objects.instance [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'flavor' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:07:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:07:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:07:28 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:07:28 user nova-compute[73520]: INFO nova.compute.manager [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Attaching volume 301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 to /dev/vdb
Aug 16 13:07:28 user nova-compute[73520]: DEBUG os_brick.utils [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 13:07:28 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1399f6-1961-41fe-aada-15caf19dadbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0fcdaf-99aa-41b8-8f11-dab844d5322f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b3ce5b-088a-4bc3-b481-31fffac5f455]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df45729-6c6b-4dcf-bf34-54c588c24187]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 13:07:29 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 13:07:29 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d0de5d-b170-4187-8c80-3831c254f641]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG os_brick.utils [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 13:07:29 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating existing volume attachment record: 47d2426d-44ad-4b4d-b5af-61aae7a934be {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 13:07:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:07:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:07:34 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXpkzOqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 13:07:38 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 13:07:38 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 13:07:38 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd4ca67-d4ab-4d18-b39a-e9e19575c1cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 13:07:38 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5d5dae-2d88-484c-8d0e-8a322648dab9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005] added
Aug 16 13:07:38 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be63158-ed70-42f9-ba54-aa3dc11d01e8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6b7068-1c06-47e1-a228-73029bc1c2b5]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CXpkzOqI {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CXpkzOqI" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[670a46f2-a99d-4d57-a20c-ea6954a026df]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CXpkzOqI'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[04913b7b-9930-443c-ae80-d89b20b498e8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67afad6-7a3f-4bb6-bfa6-ce1fabd684f7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 13:07:38 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 13:07:38 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 13:07:38 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 13:07:38 user nova-compute[73520]: 
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc71ff03-0b6c-4166-af1f-a396f5a8cb75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005, portal: 172.16.0.220,3260]
Aug 16 13:07:38 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005, portal: 172.16.0.220,3260] successful.
Aug 16 13:07:38 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90febae-d79b-4261-9146-70109ba45b72]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cc1f96-44d5-4997-9bfb-fbb3ff5b8799]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 (non-flash)
Aug 16 13:07:38 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 (non-flash)
Aug 16 13:07:38 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b89fb2-2c5e-4c83-98b7-63493e73def0]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:38 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 13:07:39 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 13:07:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXpkzOqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 13:07:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 13:07:39 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23266633139643964', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 13:07:39 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266633139643964', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 13:07:39 user nova-compute[73520]: DEBUG nova.objects.instance [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'flavor' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:07:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 13:07:40 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:07:40 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:07:40 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:07:40 user nova-compute[73520]:   <serial>301e8f77-2f96-44e9-bb6e-8fa1cf3d7005</serial>
Aug 16 13:07:40 user nova-compute[73520]: </disk>
Aug 16 13:07:40 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 13:07:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 13:07:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 13:07:40 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No VIF found with MAC fa:16:3e:1c:75:46, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 13:07:40 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-61635caf-8079-4588-8302-b5db423cca6a tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.647s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:07:42 user nova-compute[73520]: INFO nova.compute.manager [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Detaching volume 301e8f77-2f96-44e9-bb6e-8fa1cf3d7005
Aug 16 13:07:42 user nova-compute[73520]: INFO nova.virt.block_device [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Attempting to driver detach volume 301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 from mountpoint /dev/vdb
Aug 16 13:07:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Attempting to detach device vdb from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 13:07:42 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:07:42 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:07:42 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:07:42 user nova-compute[73520]:   <serial>301e8f77-2f96-44e9-bb6e-8fa1cf3d7005</serial>
Aug 16 13:07:42 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 13:07:42 user nova-compute[73520]: </disk>
Aug 16 13:07:42 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 13:07:42 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Successfully detached device vdb from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the persistent domain config.
Aug 16 13:07:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 13:07:42 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:07:42 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:07:42 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:07:42 user nova-compute[73520]:   <serial>301e8f77-2f96-44e9-bb6e-8fa1cf3d7005</serial>
Aug 16 13:07:42 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 13:07:42 user nova-compute[73520]: </disk>
Aug 16 13:07:42 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692191262.774362, 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 13:07:42 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Successfully detached device vdb from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the live domain config.
Aug 16 13:07:42 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXpkzOqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 13:07:42 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[683400cf-7074-4f3a-a9a0-3e7fe7d1d731]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a9da33-f12f-42d3-a8f7-dd6f9d7afa75]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 (non-flash)
Aug 16 13:07:42 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 (non-flash)
Aug 16 13:07:42 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c403520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d327e358-730a-49d2-a02f-fabc5fc34cff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[7248c4c0-a90a-4a3a-ab87-cfbb76fcc693]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffab9e85-9c6c-4b1a-b6ee-46e22d788fa3]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[54df9d6a-05de-4cff-9a1d-6a330c3bb6fe]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbc794b-3adb-4153-831d-5f60082c7eb7]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:07:42 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39dcf56-215b-411b-abbe-d8e204c5a39c]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005, portal: 172.16.0.220,3260]
Aug 16 13:07:43 user nova-compute[73520]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005, portal: 172.16.0.220,3260] successful.
Aug 16 13:07:43 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301e8f77-2f96-44e9-bb6e-8fa1cf3d7005 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[062793f2-ee17-47dc-bbb4-99530db98e64]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.248s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] <== disconnect_volume: return (249ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG nova.objects.instance [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'flavor' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:07:43 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-911c571a-43a6-442a-b5cf-8dc21df3b917 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.670s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:07:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:07:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:07:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:07:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:08:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:08:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:08:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:08:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:08:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:08:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:08:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:08:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:09 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:08:10 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:08:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 13:08:12 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:08:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:16 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:08:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:08:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:08:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:08:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:08:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:08:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:18 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:08:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:08:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:08:18 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:08:18 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 13:08:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:19 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:08:19 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:08:19 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=25.164623260498047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 13:08:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:08:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:08:19 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 13:08:19 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 13:08:19 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 13:08:19 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:08:20 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:08:20 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 13:08:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:08:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:08:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:08:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:08:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:08:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:08:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:08:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:08:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:08:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:08:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 13:08:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 13:08:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:08:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:08:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 13:08:26 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:08:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating instance_info_cache with network_info: [{"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:08:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:08:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 13:08:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:08:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'flavor' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:08:36 user nova-compute[73520]: INFO nova.compute.manager [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Attaching volume a9b8ba4d-8145-4456-9d0a-71dafaf82e7d to /dev/vdb
Aug 16 13:08:36 user nova-compute[73520]: DEBUG os_brick.utils [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8acb6a-72e4-48d3-9b3d-0740ec4a77d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4741f0f-cc1c-4a48-8481-1cd3a63394af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee94c10e-47dd-4e79-8e11-9ea9a7bdc0e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec80f08-650d-4a6f-ab08-e76268841307]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 13:08:36 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 13:08:36 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a6d0c1-ef08-4e91-a9a4-82eabf57c856]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG os_brick.utils [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 13:08:36 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating existing volume attachment record: 67136d06-131a-4196-ab40-0e9386b16c41 {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 13:08:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:08:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scLJNpjy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 13:08:46 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 13:08:46 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 13:08:46 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed365004-9a7b-46d0-bd36-e43b1067021d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 13:08:46 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6074a0-dc65-4d4b-9446-4a31a7ca6a8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d] added
Aug 16 13:08:46 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[94023d53-b2f7-469c-ba62-53acf42ff396]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.053s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62390e2-9c4a-4458-86b7-3be5fa11ac21]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scLJNpjy {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scLJNpjy" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b117d8c-369b-462e-b28e-d8f80ab47816]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'scLJNpjy'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe0724d-44c0-4568-9ebf-7ee74cda4bab]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a5da0c-77ca-4f78-8c4f-43d70e7296eb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 13:08:46 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 13:08:46 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 13:08:46 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 13:08:46 user nova-compute[73520]: 
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5a68e0-4a82-4c37-9de1-2e0a848426ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d, portal: 172.16.0.220,3260]
Aug 16 13:08:46 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d, portal: 172.16.0.220,3260] successful.
Aug 16 13:08:46 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f79554-2e25-4c29-8dbf-f3c5ed71f4cd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc4f028-176d-4c8b-af34-561882efac9e]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d (non-flash)
Aug 16 13:08:46 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d (non-flash)
Aug 16 13:08:46 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec610334-db84-463b-9af6-9355bcac96de]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:46 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 13:08:47 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 13:08:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scLJNpjy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 13:08:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 13:08:47 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23164303336666239', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 13:08:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164303336666239', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 13:08:47 user nova-compute[73520]: DEBUG nova.objects.instance [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'flavor' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:08:47 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 13:08:47 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:08:47 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:08:47 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:08:47 user nova-compute[73520]:   <serial>a9b8ba4d-8145-4456-9d0a-71dafaf82e7d</serial>
Aug 16 13:08:47 user nova-compute[73520]: </disk>
Aug 16 13:08:47 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 13:08:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 13:08:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 13:08:48 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No VIF found with MAC fa:16:3e:1c:75:46, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 13:08:48 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-f0fcfb92-16ec-40fe-b664-e5f02bb40916 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.693s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:08:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:08:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:08:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:08:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:08:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:08:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:08:50 user nova-compute[73520]: INFO nova.compute.manager [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Detaching volume a9b8ba4d-8145-4456-9d0a-71dafaf82e7d
Aug 16 13:08:50 user nova-compute[73520]: INFO nova.virt.block_device [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Attempting to driver detach volume a9b8ba4d-8145-4456-9d0a-71dafaf82e7d from mountpoint /dev/vdb
Aug 16 13:08:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Attempting to detach device vdb from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 13:08:50 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:08:50 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:08:50 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:08:50 user nova-compute[73520]:   <serial>a9b8ba4d-8145-4456-9d0a-71dafaf82e7d</serial>
Aug 16 13:08:50 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 13:08:50 user nova-compute[73520]: </disk>
Aug 16 13:08:50 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 13:08:50 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Successfully detached device vdb from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the persistent domain config.
Aug 16 13:08:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 13:08:50 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:08:50 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:08:50 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:08:50 user nova-compute[73520]:   <serial>a9b8ba4d-8145-4456-9d0a-71dafaf82e7d</serial>
Aug 16 13:08:50 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 13:08:50 user nova-compute[73520]: </disk>
Aug 16 13:08:50 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692191330.8083875, 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 13:08:50 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Successfully detached device vdb from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the live domain config.
Aug 16 13:08:50 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scLJNpjy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 13:08:50 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6ff884-b96e-429e-ac79-6a2607ada5b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[9914f32c-86ee-46f3-b849-75accbb4e7e5]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d (non-flash)
Aug 16 13:08:50 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d (non-flash)
Aug 16 13:08:50 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa75c120ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[319d0941-c401-4803-bc2e-7721a3216a13]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1d2e66-6490-48c4-89b8-f4d3bd64769e]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc48651-5a44-445a-bdd3-6346e4e23854]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8861245e-0e82-49b7-87e4-0d00cbb709da]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2645a04-c2be-479a-af4d-c27e13831efd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:08:50 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[195eec7b-baae-487e-9d0e-b475ab04f064]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d, portal: 172.16.0.220,3260]
Aug 16 13:08:51 user nova-compute[73520]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d, portal: 172.16.0.220,3260] successful.
Aug 16 13:08:51 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:08:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:08:51 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b8ba4d-8145-4456-9d0a-71dafaf82e7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:08:51 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d23f77d-6fd1-4ba8-aed5-3c2d14903cdd]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:08:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:08:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 13:08:51 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] <== disconnect_volume: return (246ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 13:08:51 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 13:08:51 user nova-compute[73520]: DEBUG nova.objects.instance [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'flavor' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:08:51 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-7799ef5b-2a88-4304-8572-6f85e5dfad76 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.714s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:08:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:08:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:09:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:09:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:09:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:09:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:09:09 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:09:10 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:09:10 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 13:09:11 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:09:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:09:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:09:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:09:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:09:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:14 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:09:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:09:18 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:09:18 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:19 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:09:19 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:09:19 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=25.155853271484375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 13:09:19 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing inventories for resource provider 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 13:09:20 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating ProviderTree inventory for provider 70dde5f5-9594-47c3-954e-598dd3089747 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 13:09:20 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Updating inventory in ProviderTree for provider 70dde5f5-9594-47c3-954e-598dd3089747 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 13:09:20 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing aggregate associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, aggregates: None {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 13:09:20 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Refreshing trait associations for resource provider 70dde5f5-9594-47c3-954e-598dd3089747, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO {{(pid=73520) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 13:09:20 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:09:20 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:09:20 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 13:09:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:09:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:09:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:09:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:09:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:09:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:09:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:09:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:09:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:09:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 13:09:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 13:09:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:09:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:09:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 13:09:26 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:09:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating instance_info_cache with network_info: [{"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:09:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:09:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 13:09:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:09:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:09:37 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:09:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:09:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:09:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:09:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:09:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG nova.objects.instance [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'flavor' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:09:45 user nova-compute[73520]: INFO nova.compute.manager [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Attaching volume b689c34a-3582-487c-8cf5-d60735611bde to /dev/vdb
Aug 16 13:09:45 user nova-compute[73520]: DEBUG os_brick.utils [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fa1838-2d25-48d2-8cd9-3f71243c1626]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a46482b12142\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd863ce-3137-4b92-810f-bbc7e23fce6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cc9844-ec7b-4f0e-9ffb-944555fb9dda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbc56e4-4999-46ef-8df7-8890914c89a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Running cmd (subprocess): nvme version {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] 'nvme version' failed. Not Retrying. {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] nvme not present on system {{(pid=73520) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 13:09:45 user nova-compute[73520]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 13:09:45 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6244b6b1-6da1-4d65-bbfb-c827d4987fd9]: (4, '') {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73520) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] LIGHTOS: no hostnqn found. {{(pid=73520) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG os_brick.utils [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a46482b12142', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 13:09:45 user nova-compute[73520]: DEBUG nova.virt.block_device [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating existing volume attachment record: 0c2b1829-36e3-4b0c-b556-662cd9cdaeec {{(pid=73520) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 13:09:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:49 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:09:49 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 13:09:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] There are 0 instances to clean {{(pid=73520) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 13:09:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Calling os-brick to attach iSCSI Volume {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNiULEWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 13:09:55 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 13:09:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 13:09:55 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 13:09:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 13:09:55 user nova-compute[73520]: INFO os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aefb676-7d7b-47fd-8e31-24f15fe3de8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 13:09:55 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --interface default --op new {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e774c18-3e66-41be-9f00-04ad0fb55c33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde] added\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde] added
Aug 16 13:09:55 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[d957441d-9f37-4ba2-8377-6aebd5b341d8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8327c2-1494-4313-9c4f-8cd97799c949]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FNiULEWt {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FNiULEWt" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cb0756-390f-4bbd-aa40-877e624b91a9]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FNiULEWt'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:09:55 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f5d246-7f22-4172-9f3a-6a64cac092a8]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[36462708-471d-4d64-9e37-b42c9fc90119]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 13:09:56 user nova-compute[73520]:  {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 13:09:56 user nova-compute[73520]:  {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 13:09:56 user nova-compute[73520]: WARNING os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 13:09:56 user nova-compute[73520]: 
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --login {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d986614-7f46-4966-8b3b-e98d76925952]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde, portal: 172.16.0.220,3260]
Aug 16 13:09:56 user nova-compute[73520]: Login to [iface: default, target: iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde, portal: 172.16.0.220,3260] successful.
Aug 16 13:09:56 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf5d7ae-6e0c-4955-bf2b-b5b11d3729ee]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[169b1a52-e255-4372-921e-f1935708554b]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde (non-flash)
Aug 16 13:09:56 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde (non-flash)
Aug 16 13:09:56 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Connected to 172.16.0.220:3260 {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73520) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73520) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dee58fa-3603-404b-be4d-ecc979820bda]: (4, ('- - 0', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73520) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 13:09:56 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNiULEWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73520) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 13:09:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 13:09:57 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23036363863663362', 'path': '/dev/sdb'} {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 13:09:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036363863663362', 'path': '/dev/sdb'} {{(pid=73520) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 13:09:57 user nova-compute[73520]: DEBUG nova.objects.instance [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'flavor' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:09:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 13:09:57 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:09:57 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:09:57 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:09:57 user nova-compute[73520]:   <serial>b689c34a-3582-487c-8cf5-d60735611bde</serial>
Aug 16 13:09:57 user nova-compute[73520]: </disk>
Aug 16 13:09:57 user nova-compute[73520]:  {{(pid=73520) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 13:09:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No BDM found with device name vda, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 13:09:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73520) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 13:09:57 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] No VIF found with MAC fa:16:3e:1c:75:46, not building metadata {{(pid=73520) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 13:09:57 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-0f1cdd21-9f0a-4bd7-91cc-5ef990c70c7b tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.069s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:09:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:09:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:09:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:09:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:09:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:09:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:10:00 user nova-compute[73520]: INFO nova.compute.manager [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Detaching volume b689c34a-3582-487c-8cf5-d60735611bde
Aug 16 13:10:00 user nova-compute[73520]: INFO nova.virt.block_device [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Attempting to driver detach volume b689c34a-3582-487c-8cf5-d60735611bde from mountpoint /dev/vdb
Aug 16 13:10:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Attempting to detach device vdb from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the persistent domain config. {{(pid=73520) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 13:10:00 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:10:00 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:10:00 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:10:00 user nova-compute[73520]:   <serial>b689c34a-3582-487c-8cf5-d60735611bde</serial>
Aug 16 13:10:00 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 13:10:00 user nova-compute[73520]: </disk>
Aug 16 13:10:00 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 13:10:00 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Successfully detached device vdb from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the persistent domain config.
Aug 16 13:10:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the live domain config. {{(pid=73520) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.guest [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 13:10:00 user nova-compute[73520]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 13:10:00 user nova-compute[73520]:   <source dev="/dev/sdb"/>
Aug 16 13:10:00 user nova-compute[73520]:   <target dev="vdb" bus="virtio"/>
Aug 16 13:10:00 user nova-compute[73520]:   <serial>b689c34a-3582-487c-8cf5-d60735611bde</serial>
Aug 16 13:10:00 user nova-compute[73520]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 13:10:00 user nova-compute[73520]: </disk>
Aug 16 13:10:00 user nova-compute[73520]:  {{(pid=73520) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-c6310bb3-071f-430e-a31f-52805efe8002 None None] Received event <DeviceRemovedEvent: 1692191400.7708523, 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73520) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.driver [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 13:10:00 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Successfully detached device vdb from instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a from the live domain config.
Aug 16 13:10:00 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] calling os-brick to detach iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa75c7d0730>, {'target_iqns': ['iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNiULEWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 13:10:00 user nova-compute[73520]: WARNING os_brick.initiator.connectors.base [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde', 0)] {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[5443a6e5-7bb0-4fd6-b9cf-cd19ca9398d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[190f2d9b-463f-4265-9aca-cd8e90796f79]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde (non-flash)\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde (non-flash)
Aug 16 13:10:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde (non-flash)
Aug 16 13:10:00 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa73c6929e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde'): ({'sdb'}, set())}) {{(pid=73520) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Removing single pathed devices sdb {{(pid=73520) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a644e0-e776-4464-ba19-3e1789761727]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1b528b-82c4-45d5-9007-4a17ec1fe9c7]: (4, ('ok\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Flushing IO for device /dev/sdb {{(pid=73520) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[668c6352-d814-4a6f-91fb-32036428a1d7]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73520) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[3885158b-914a-46a7-9f07-f965ac53bef9]: (4, ('1', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.linuxscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] SCSI volumes sdb have been removed. {{(pid=73520) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde')] {{(pid=73520) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0b83e7-f134-4d14-9f84-943ff46afa3f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:10:00 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --logout {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:10:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:10:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a7896d-9821-4afd-a412-048243c75ab6]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:10:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde, portal: 172.16.0.220,3260]
Aug 16 13:10:01 user nova-compute[73520]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde, portal: 172.16.0.220,3260] successful.
Aug 16 13:10:01 user nova-compute[73520]:  stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:10:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op delete {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:10:01 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b689c34a-3582-487c-8cf5-d60735611bde -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:10:01 user nova-compute[73520]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dd938c-811f-4e35-a132-1a8f8d42963f]: (4, ('', '')) {{(pid=84372) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 13:10:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73520) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 13:10:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.base [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.239s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 13:10:01 user nova-compute[73520]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] <== disconnect_volume: return (240ms) None {{(pid=73520) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 13:10:01 user nova-compute[73520]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Disconnected iSCSI Volume {{(pid=73520) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 13:10:01 user nova-compute[73520]: DEBUG nova.objects.instance [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'flavor' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:10:01 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-ba68803c-dfb0-4ad7-82aa-d3a9035ade49 tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.608s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:10:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:10:04 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:10:04 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Triggering sync for uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 13:10:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:10:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:10:04 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:10:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:10:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:10:08 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:10:08 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73520) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 13:10:09 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:10:11 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:10:11 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 13:10:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:10:14 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:10:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:10:18 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:10:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:10:20 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:10:21 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:10:21 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:10:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=25.154808044433594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 13:10:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:10:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:10:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:10:23 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:10:25 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:10:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 13:10:25 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 13:10:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:10:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:10:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 13:10:26 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:10:26 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating instance_info_cache with network_info: [{"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:10:26 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:10:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 13:10:27 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:10:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:10:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:10:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:10:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:10:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:10:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:10:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:10:38 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:10:43 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:10:48 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:10:53 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:10:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:10:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:10:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:10:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:10:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:10:58 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:11:03 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:11:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:11:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:11:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:11:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:11:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:11:08 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:10 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:11:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:11:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:11:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:11:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:11:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:13 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:11:13 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:11:13 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 13:11:14 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:11:18 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:20 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:11:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:11:21 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:11:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:11:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:11:21 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:11:21 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 13:11:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:11:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:11:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 13:11:22 user nova-compute[73520]: DEBUG oslo_concurrency.processutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 13:11:22 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:11:22 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:11:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8810MB free_disk=25.153945922851562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 13:11:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:11:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:11:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73520) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 13:11:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 13:11:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 13:11:22 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:11:22 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:11:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 13:11:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:11:23 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:24 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:11:26 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:11:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 13:11:26 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 13:11:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 13:11:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquired lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 13:11:27 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Forcefully refreshing network info cache for instance {{(pid=73520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 13:11:27 user nova-compute[73520]: DEBUG nova.objects.instance [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lazy-loading 'info_cache' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:11:27 user nova-compute[73520]: DEBUG nova.network.neutron [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating instance_info_cache with network_info: [{"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:11:27 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Releasing lock "refresh_cache-45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" {{(pid=73520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 13:11:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updated the network info_cache for instance {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 13:11:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:11:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:11:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:11:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:11:28 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:28 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:11:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:11:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:11:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:11:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:11:34 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:11:34 user nova-compute[73520]: INFO nova.compute.manager [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Terminating instance
Aug 16 13:11:34 user nova-compute[73520]: DEBUG nova.compute.manager [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Start destroying the instance on the hypervisor. {{(pid=73520) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 13:11:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:34 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-29ab44e3-1406-4651-b2a5-3e9d9fce5e80 req-2231f6ed-4b60-4446-9c86-976d92182335 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Received event network-vif-unplugged-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-29ab44e3-1406-4651-b2a5-3e9d9fce5e80 req-2231f6ed-4b60-4446-9c86-976d92182335 service nova] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-29ab44e3-1406-4651-b2a5-3e9d9fce5e80 req-2231f6ed-4b60-4446-9c86-976d92182335 service nova] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-29ab44e3-1406-4651-b2a5-3e9d9fce5e80 req-2231f6ed-4b60-4446-9c86-976d92182335 service nova] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-29ab44e3-1406-4651-b2a5-3e9d9fce5e80 req-2231f6ed-4b60-4446-9c86-976d92182335 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] No waiting events found dispatching network-vif-unplugged-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG nova.compute.manager [req-29ab44e3-1406-4651-b2a5-3e9d9fce5e80 req-2231f6ed-4b60-4446-9c86-976d92182335 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Received event network-vif-unplugged-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 for instance with task_state deleting. {{(pid=73520) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 13:11:35 user nova-compute[73520]: INFO nova.virt.libvirt.driver [-] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Instance destroyed successfully.
Aug 16 13:11:35 user nova-compute[73520]: DEBUG nova.objects.instance [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lazy-loading 'resources' on Instance uuid 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a {{(pid=73520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG nova.virt.libvirt.vif [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T13:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-538797321',display_name='tempest-SnapshotDataIntegrityTests-server-538797321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-538797321',id=53,image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/oB47s67mBfJ1HYtKAHNpd7eGbWYYq4+ctlyvU2eHmo8dif0Z1LkGnnBC1cJLjj+jKsDEVQTZ7qL6eOFYIUMYuEgIwv+/2ulE1dHZn0gX18rE06QX1XGxSWSwRd115ZQ==',key_name='tempest-keypair-50425724',keypairs=<?>,launch_index=0,launched_at=2023-08-16T13:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c32f1c3fd31467f914bcd95bb38a185',ramdisk_id='',reservation_id='r-ih1jgpkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee029f85-bd8a-43a7-b5cf-88e5bdcbf4fe',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-762927158',owner_user_name='tempest-SnapshotDataIntegrityTests-762927158-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T13:04:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b22915f2cb041ca8db38da06b786e7b',uuid=45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Converting VIF {"id": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "address": "fa:16:3e:1c:75:46", "network": {"id": "ea33ef5c-9a03-479c-a61f-495ecd67f7c7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468157435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c32f1c3fd31467f914bcd95bb38a185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dbc9c78-d7", "ovs_interfaceid": "6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG nova.network.os_vif_util [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7,network=Network(ea33ef5c-9a03-479c-a61f-495ecd67f7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbc9c78-d7') {{(pid=73520) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG os_vif [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7,network=Network(ea33ef5c-9a03-479c-a61f-495ecd67f7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbc9c78-d7') {{(pid=73520) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6dbc9c78-d7, bridge=br-int, if_exists=True) {{(pid=73520) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:11:35 user nova-compute[73520]: INFO os_vif [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:75:46,bridge_name='br-int',has_traffic_filtering=True,id=6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7,network=Network(ea33ef5c-9a03-479c-a61f-495ecd67f7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dbc9c78-d7')
Aug 16 13:11:35 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Deleting instance files /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a_del
Aug 16 13:11:35 user nova-compute[73520]: INFO nova.virt.libvirt.driver [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Deletion of /opt/stack/data/nova/instances/45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a_del complete
Aug 16 13:11:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:35 user nova-compute[73520]: INFO nova.compute.manager [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 16 13:11:35 user nova-compute[73520]: DEBUG oslo.service.loopingcall [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73520) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG nova.compute.manager [-] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Deallocating network for instance {{(pid=73520) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 13:11:35 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] deallocate_for_instance() {{(pid=73520) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 13:11:36 user nova-compute[73520]: DEBUG nova.network.neutron [-] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Updating instance_info_cache with network_info: [] {{(pid=73520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 13:11:36 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Took 1.01 seconds to deallocate network for instance.
Aug 16 13:11:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:11:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:11:36 user nova-compute[73520]: DEBUG nova.compute.manager [req-76a91cd1-504d-4233-8545-315f570ec6af req-e2275f91-a3bc-4f29-9161-1121f69a9853 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Received event network-vif-deleted-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 13:11:36 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:11:36 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:11:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:11:36 user nova-compute[73520]: INFO nova.scheduler.client.report [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Deleted allocations for instance 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a
Aug 16 13:11:36 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-1c5c5f02-ab8b-4081-8748-2d98b839635e tempest-SnapshotDataIntegrityTests-762927158 tempest-SnapshotDataIntegrityTests-762927158-project-member] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.294s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:11:37 user nova-compute[73520]: DEBUG nova.compute.manager [req-1325a0d8-b72d-4828-bbb1-3a1f6ea85366 req-c4ed3cd9-041f-45ff-86d2-879f6fcd47d3 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Received event network-vif-plugged-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 13:11:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1325a0d8-b72d-4828-bbb1-3a1f6ea85366 req-c4ed3cd9-041f-45ff-86d2-879f6fcd47d3 service nova] Acquiring lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:11:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1325a0d8-b72d-4828-bbb1-3a1f6ea85366 req-c4ed3cd9-041f-45ff-86d2-879f6fcd47d3 service nova] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:11:37 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [req-1325a0d8-b72d-4828-bbb1-3a1f6ea85366 req-c4ed3cd9-041f-45ff-86d2-879f6fcd47d3 service nova] Lock "45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:11:37 user nova-compute[73520]: DEBUG nova.compute.manager [req-1325a0d8-b72d-4828-bbb1-3a1f6ea85366 req-c4ed3cd9-041f-45ff-86d2-879f6fcd47d3 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] No waiting events found dispatching network-vif-plugged-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 {{(pid=73520) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 13:11:37 user nova-compute[73520]: WARNING nova.compute.manager [req-1325a0d8-b72d-4828-bbb1-3a1f6ea85366 req-c4ed3cd9-041f-45ff-86d2-879f6fcd47d3 service nova] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Received unexpected event network-vif-plugged-6dbc9c78-d70e-4e1b-879d-0f673d5dd6b7 for instance with vm_state deleted and task_state None.
Aug 16 13:11:38 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:11:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:11:50 user nova-compute[73520]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692191495.3627074, 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a => Stopped> {{(pid=73520) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 13:11:50 user nova-compute[73520]: INFO nova.compute.manager [-] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] VM Stopped (Lifecycle Event)
Aug 16 13:11:50 user nova-compute[73520]: DEBUG nova.compute.manager [None req-924f3d02-a51a-4df7-8131-a385e92f32ab None None] [instance: 45c6f4a2-629a-4e64-ac88-fbefb8cd9a6a] Checking state {{(pid=73520) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 13:11:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:11:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:11:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:11:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73520) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 13:11:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:11:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73520) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 13:11:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:12:00 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:12:05 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:12:10 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:12:12 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:12:14 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:12:14 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:12:14 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73520) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 13:12:15 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:12:20 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:12:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:12:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:12:22 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:12:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:12:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:12:22 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:12:22 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Auditing locally available compute resources for user (node: user) {{(pid=73520) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 13:12:23 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:12:23 user nova-compute[73520]: WARNING nova.virt.libvirt.driver [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 13:12:23 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=25.181312561035156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73520) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 13:12:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 13:12:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 13:12:23 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 13:12:23 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73520) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 13:12:23 user nova-compute[73520]: DEBUG nova.compute.provider_tree [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed in ProviderTree for provider: 70dde5f5-9594-47c3-954e-598dd3089747 {{(pid=73520) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 13:12:23 user nova-compute[73520]: DEBUG nova.scheduler.client.report [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Inventory has not changed for provider 70dde5f5-9594-47c3-954e-598dd3089747 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73520) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 13:12:23 user nova-compute[73520]: DEBUG nova.compute.resource_tracker [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Compute_service record updated for user:user {{(pid=73520) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 13:12:23 user nova-compute[73520]: DEBUG oslo_concurrency.lockutils [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=73520) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 13:12:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:12:25 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:12:26 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:12:27 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:12:27 user nova-compute[73520]: DEBUG oslo_service.periodic_task [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 13:12:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Starting heal instance info cache {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 13:12:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Rebuilding the list of instances to heal {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 13:12:27 user nova-compute[73520]: DEBUG nova.compute.manager [None req-567e0a3c-6e95-42ae-a6c7-c6011af0d850 None None] Didn't find any instances for network info cache update. {{(pid=73520) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 13:12:29 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:12:30 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:12:33 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:12:35 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:12:40 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 13:12:45 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:12:50 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 13:12:55 user nova-compute[73520]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73520) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}